-- Logs begin at Fri 2022-09-09 11:25:36 UTC, end at Fri 2022-09-09 12:33:03 UTC. -- Sep 09 11:57:19.866667 dv-cinder-852210-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 11:57:19.876717 dv-cinder-852210-13-smb devstack@keystone.service[81762]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 11:57:19 2022] *** Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: nodename: dv-cinder-852210-13-smb Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: machine: x86_64 Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: clock source: unix Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: pcre jit disabled Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: detected number of CPU cores: 4 Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: current working directory: / Sep 09 11:57:19.878723 dv-cinder-852210-13-smb devstack@keystone.service[81762]: detected binary path: /usr/bin/uwsgi-core Sep 09 11:57:19.879345 dv-cinder-852210-13-smb devstack@keystone.service[81762]: your processes number limit is 47680 Sep 09 11:57:19.879345 dv-cinder-852210-13-smb devstack@keystone.service[81762]: your memory page size is 4096 bytes Sep 09 11:57:19.879345 dv-cinder-852210-13-smb devstack@keystone.service[81762]: detected max file descriptor number: 2048 Sep 09 11:57:19.879345 dv-cinder-852210-13-smb devstack@keystone.service[81762]: lock engine: pthread robust mutexes Sep 09 11:57:19.879345 dv-cinder-852210-13-smb devstack@keystone.service[81762]: thunder lock: enabled Sep 09 11:57:19.879345 dv-cinder-852210-13-smb devstack@keystone.service[81762]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 11:57:19.879345 dv-cinder-852210-13-smb devstack@keystone.service[81762]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 11:57:19.918578 dv-cinder-852210-13-smb devstack@keystone.service[81762]: Python main interpreter initialized at 0x5592582ad9c0 Sep 09 11:57:19.918578 dv-cinder-852210-13-smb devstack@keystone.service[81762]: python threads support enabled Sep 09 11:57:19.918578 dv-cinder-852210-13-smb devstack@keystone.service[81762]: your server socket listen backlog is limited to 100 connections Sep 09 11:57:19.918578 dv-cinder-852210-13-smb devstack@keystone.service[81762]: your mercy for graceful operations on workers is 90 seconds Sep 09 11:57:19.918927 dv-cinder-852210-13-smb devstack@keystone.service[81762]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 11:57:19.919001 dv-cinder-852210-13-smb devstack@keystone.service[81762]: *** Operational MODE: preforking *** Sep 09 11:57:19.919251 dv-cinder-852210-13-smb devstack@keystone.service[81762]: *** uWSGI is running in multiple interpreter mode *** Sep 09 11:57:19.919251 dv-cinder-852210-13-smb devstack@keystone.service[81762]: spawned uWSGI master process (pid: 81762) Sep 09 11:57:19.919463 dv-cinder-852210-13-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 09 11:57:19.920013 dv-cinder-852210-13-smb devstack@keystone.service[81762]: spawned uWSGI worker 1 (pid: 81773, cores: 1) Sep 09 11:57:19.920340 dv-cinder-852210-13-smb devstack@keystone.service[81762]: spawned uWSGI worker 2 (pid: 81774, cores: 1) Sep 09 11:57:19.920491 dv-cinder-852210-13-smb devstack@keystone.service[81762]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 11:57:24.257799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:57:24.257799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: from cryptography.utils import int_from_bytes Sep 09 11:57:24.258574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:57:24.258574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: from cryptography.utils import int_from_bytes Sep 09 11:57:24.274014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:57:24.274014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: from cryptography.utils import int_from_bytes Sep 09 11:57:24.274516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:57:24.274516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: from cryptography.utils import int_from_bytes Sep 09 11:57:24.308888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:57:24.309071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:57:24.309262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] command line args: [] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:57:24.309539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:57:24.309722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ================================================================================ {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:57:24.309981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] admin_token = **** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.310231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] config_dir = [] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.310425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.310612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] config_source = [] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.310798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] debug = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.311002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.311377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.311562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.311893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.312106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.312343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] list_limit = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.312528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] log_config_append = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.312712 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.312925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] log_dir = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.313072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] log_file = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.313315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.313568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.313826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.314076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.314260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.314442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.314752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.314975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.315172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.315589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.315811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.315925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.316143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.316380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.316665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.317166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.317513 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] publish_errors = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.317647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.317869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.318028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.318238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.318477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.318717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] standard_threads = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.319899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.319899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.320232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.320232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] use_journal = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.320447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] use_json = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.320447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] use_stderr = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.320669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] use_syslog = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.320858 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.321126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.321373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.321641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.321884 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.322104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:57:24.322186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.322311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:57:24.322445 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.322569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] command line args: [] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:57:24.322667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.322776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:57:24.322894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.323012 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ================================================================================ {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:57:24.323129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.323251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] admin_token = **** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.323362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.323472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] config_dir = [] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.323581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.323719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.323843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] config_source = [] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.323962 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.324087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] debug = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.324199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.324314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.324460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.324584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.324701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.324795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.324958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.325070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.325240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.325345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.325451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.325552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] list_limit = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.325552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] log_config_append = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.325740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.325835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.325928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.326031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] log_dir = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.326031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] log_file = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.326214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.326321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.326421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.326525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.326623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.326716 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.326818 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.326922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.327019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.327110 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.327296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.327401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.327495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.327597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.344990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.345162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.345249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.345324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.345477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.345555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.345627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.345698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.345768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.345840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.345919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.345998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.346075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.346146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.346216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.346291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.346374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.346374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.346508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.346586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.346665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] publish_errors = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.346737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.346899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.346987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.347060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.347060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.347197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.347197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.347383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.347461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.347531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.347601 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.347710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] standard_threads = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.347785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.347902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.347984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.348056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.348056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.348192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.348265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] use_journal = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.348335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.348404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] use_json = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.348473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.348548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] use_stderr = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.348548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] use_syslog = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.348685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.348754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:24.348829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.348900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.348976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349434 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.349933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350723 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350723 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.350940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351138 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.351982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352672 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.352953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.353958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354580 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.354967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.355850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356625 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.356970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357473 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.357975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358815 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.358985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] auth.external = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359258 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] auth.password = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359805 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] auth.token = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.359952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360150 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.360962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] credential.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361805 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.361980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362858 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.362985 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] federation.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363339 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.363961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364110 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.364950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.365902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.366480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.366567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.366641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.366712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.366782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.366853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] auth.external = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.367314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.367771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.367862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.367936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368088 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] auth.password = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] auth.token = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.368949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] credential.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.369993 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370207 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370499 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.370943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371913 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] federation.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.371989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.372062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.372141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.372491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.372700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.372767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.372841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.372922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.373995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374500 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.374940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375741 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.375970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.376995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377350 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377865 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377865 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.377994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.378949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379459 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] resource.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.379985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380201 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.380989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.381059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.381129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.381199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] role.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.381277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.381349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] role.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.381349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.381467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.381467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.381582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382485 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382485 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382747 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.382964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.383949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.384032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.384198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.384418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.384499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.384665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.384747 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.384922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.385011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.385172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.385253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.385406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.385484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.385662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.385790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.385906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.385970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.386130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.386219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.386368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.386458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.386605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.386685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.386840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.386918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.387079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.387170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.387316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.387395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.387572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.387673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.387830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.387911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.388080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.388173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.388322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.388409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.388558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.388637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.388794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.388874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.389036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] token.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.389121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.389277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.389358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.389511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.389584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.389756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.389897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.389987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] resource.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.390064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.390238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.390319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.390661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.390743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.390743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.390864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.390935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.391005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.391193 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.391273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.391429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.391509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.391693 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.391775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.391935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.392014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.392177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.392259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.392418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] role.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.392549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.392678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] role.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.392806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.392946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.393095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.393231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.393358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.393486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.393616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.connection = **** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.393743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.393877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.394003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.394130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.394259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.394388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.394515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.394650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.394786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.394913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.395040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.395170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.395296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.395444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.395596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.395733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.395850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.395965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.396080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.396209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.396328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.396444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.396444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.396666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.396783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.396912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.397030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.397145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.397290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.397439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.397575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.397701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.397818 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.397933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.398048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.398169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.398307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:57:24.398433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.398433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.398651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.398764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.398944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.399178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.399430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.399710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.399961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.400201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.400442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.400674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.400913 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] token.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.401151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.401401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.401641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.401901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.402151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.402391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.402638 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.402883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.403133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.403371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.403612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.419403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.419403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.419403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.419403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.419403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.419403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.419403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.connection = **** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.419403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.419403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:24.420722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:57:24.427221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.427414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.427781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.436816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.439009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.439408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.439829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.451525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.466269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.466503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.479657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.479896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.525535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.529063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.582438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.582648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.582739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.582816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.753600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.753600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.753917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.754014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.754091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.754164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.754236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.754358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.754436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.754508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.754580 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.754580 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.774182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.774416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.774536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.774650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.774773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.774879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.775000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.775103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.775223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.775323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.775442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.775532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.775688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.775910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.786713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.786887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.807194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.807356 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.807443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.807595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.807689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.807854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.807951 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.808084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.808163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.808302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.808381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.808517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.808598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.808729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:57:24.831404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.831538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.831668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:57:24.831753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:57:24.832025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.832107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.832230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:57:24.832311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:57:24.832521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.832604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.832772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.832851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.833034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.833122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.833292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.833371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.842915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.843017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.843195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.843291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.843467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.843547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.843774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.843858 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.851278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.851650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.854225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.854517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.854605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.854806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.854891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.855095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.855178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.855386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.855467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.855674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.855764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.855950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.856033 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.856229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.856324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.856504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.856586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.856776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.856856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.857047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.857127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.857317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.880573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.880759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.882080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.882261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.882374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.882552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.887156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.887250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.887447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.887521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.887762 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.887846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.894099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.894199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.894389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.894473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.900223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.900331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.900522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.900621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.900811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.900893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.901098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.901178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.901379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.901461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.901659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.901739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.901932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.902022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.902203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.902284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.918098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.918273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.918385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.918557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.922208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.922444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.925401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.925703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.925917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.925998 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.930417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.930755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.933499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.934660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.936790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.937094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.937171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.937386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.937595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.937666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.937729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.937942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.938081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.938226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.938312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.938563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.953855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.954122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.954211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.954405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.954487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.954671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.954754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.954938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.961602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.961724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.963138 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.963221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.964692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.964779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.965059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.965156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.967724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.967811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.968015 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.968098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.968305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.968388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.968593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.968686 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.968991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.969075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.980634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.980751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.980926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.981014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.981212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.981296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.981500 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.981583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.981886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.981969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.982171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.982253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.982455 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.982545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:24.998695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:24.998804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.001659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.001760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.004632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.004731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.006029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.006126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.007516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.007676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.007826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.007912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.008236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.008320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.014577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.014690 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.016061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.016149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.018950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.019062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.019346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.019480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.019649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.019734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.019931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.020012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.028273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.028367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.028569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.028664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.028856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.028953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.035744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.035980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:57:25.036106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.036450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.036568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.036653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.036731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.036835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.036920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.037111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.037195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.037383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.037465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.037657 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.037748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.038475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.038613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.038742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.038873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.039014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.039148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.039290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.039422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.039557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.039659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.039851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.039983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.040168 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:57:25.073953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5592582ad9c0 pid: 81773 (default app) Sep 09 11:57:25.074138 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5592582ad9c0 pid: 81774 (default app) Sep 09 11:57:25.077347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf75ace-9f2e-4f3c-abd6-f4cd4908f6ba None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:25.077635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf75ace-9f2e-4f3c-abd6-f4cd4908f6ba None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:25.077909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf75ace-9f2e-4f3c-abd6-f4cd4908f6ba None None] PATH_INFO: `/v3` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:25.082095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Fri Sep 9 11:57:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:32.781993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5320f-ee4f-48f9-a5fe-e4c4ec8c61b6 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:32.782521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5320f-ee4f-48f9-a5fe-e4c4ec8c61b6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:32.782521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5320f-ee4f-48f9-a5fe-e4c4ec8c61b6 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:32.786812 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:57:32.792946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:32.793400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:32.793496 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:32.864647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: INFO dbcounter [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] Registered counter for database keystone Sep 09 11:57:32.884271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG oslo_db.sqlalchemy.engines [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:32.890434 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writer thread running {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:33.076249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG passlib.handlers.bcrypt [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81773) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 11:57:33.076632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG passlib.handlers.bcrypt [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81773) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 11:57:33.135577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:33.137250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:33.264163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 11:57:33.732148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5320f-ee4f-48f9-a5fe-e4c4ec8c61b6 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:33.805044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: INFO dbcounter [None req-ecc5320f-ee4f-48f9-a5fe-e4c4ec8c61b6 None None] Registered counter for database keystone Sep 09 11:57:33.826425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG oslo_db.sqlalchemy.engines [None req-ecc5320f-ee4f-48f9-a5fe-e4c4ec8c61b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:33.832806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writer thread running {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:33.953388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5320f-ee4f-48f9-a5fe-e4c4ec8c61b6 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:33.957707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031549af-20d3-4134-b077-de01a41854fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:33.958336 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031549af-20d3-4134-b077-de01a41854fa admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:33.958618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031549af-20d3-4134-b077-de01a41854fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:33.958890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031549af-20d3-4134-b077-de01a41854fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:33.967054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031549af-20d3-4134-b077-de01a41854fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:34.019148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WARNING keystone.common.rbac_enforcer.enforcer [None req-031549af-20d3-4134-b077-de01a41854fa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 11:57:34.019425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031549af-20d3-4134-b077-de01a41854fa admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:34.029597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Sep 9 11:57:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:57:34.035745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:34.052944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3c34-0a7b-4bfa-b142-f9802af9c834 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:34.057304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb499d9-1aa6-43cd-a54a-560dcd328134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:34.058415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb499d9-1aa6-43cd-a54a-560dcd328134 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:34.058696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb499d9-1aa6-43cd-a54a-560dcd328134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:34.058965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb499d9-1aa6-43cd-a54a-560dcd328134 admin admin] PATH_INFO: `/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:34.060566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb499d9-1aa6-43cd-a54a-560dcd328134 admin admin] RBAC: Authorizing `identity:get_project(project_id=a957b728ec1a4c5cb1b61c4acd7d2959)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:34.116586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fcb499d9-1aa6-43cd-a54a-560dcd328134 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 11:57:34.117430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb499d9-1aa6-43cd-a54a-560dcd328134 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:34.122020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Fri Sep 9 11:57:34 2022] GET /identity/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:36.281391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad343c-1f36-4dc0-b9b2-0bc87b38db8c None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:36.281897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad343c-1f36-4dc0-b9b2-0bc87b38db8c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:36.281981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad343c-1f36-4dc0-b9b2-0bc87b38db8c None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:36.285986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:36.291528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572690a-a2d2-4c2c-8da5-2d7aaf81ff53 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:36.292147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572690a-a2d2-4c2c-8da5-2d7aaf81ff53 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:36.292147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572690a-a2d2-4c2c-8da5-2d7aaf81ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:36.312373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f572690a-a2d2-4c2c-8da5-2d7aaf81ff53 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:36.313897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f572690a-a2d2-4c2c-8da5-2d7aaf81ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:36.322343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 11:57:36.604159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad343c-1f36-4dc0-b9b2-0bc87b38db8c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:36.616211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad343c-1f36-4dc0-b9b2-0bc87b38db8c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:36.620379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b914c36-d820-4eee-8d91-258cc525d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:36.620974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b914c36-d820-4eee-8d91-258cc525d591 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:36.621257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b914c36-d820-4eee-8d91-258cc525d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:36.621532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b914c36-d820-4eee-8d91-258cc525d591 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:36.629434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b914c36-d820-4eee-8d91-258cc525d591 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:36.631221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b914c36-d820-4eee-8d91-258cc525d591 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:36.640347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Sep 9 11:57:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:57:36.645885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572690a-a2d2-4c2c-8da5-2d7aaf81ff53 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:36.655480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572690a-a2d2-4c2c-8da5-2d7aaf81ff53 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:36.659933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af456ee5-f78e-4a22-b5a1-2b51f9b776c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:36.660545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af456ee5-f78e-4a22-b5a1-2b51f9b776c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:36.660830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af456ee5-f78e-4a22-b5a1-2b51f9b776c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:36.661106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af456ee5-f78e-4a22-b5a1-2b51f9b776c4 admin admin] PATH_INFO: `/v3/users/e0d78cac7890401997b98a7dab7b659c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:36.662426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af456ee5-f78e-4a22-b5a1-2b51f9b776c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0d78cac7890401997b98a7dab7b659c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:36.664821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af456ee5-f78e-4a22-b5a1-2b51f9b776c4 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:36.666338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Fri Sep 9 11:57:36 2022] GET /identity/v3/users/e0d78cac7890401997b98a7dab7b659c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:38.898490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c3a5-5b85-4a7f-9347-1c82e570cf0a None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:38.899033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c3a5-5b85-4a7f-9347-1c82e570cf0a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:38.899033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c3a5-5b85-4a7f-9347-1c82e570cf0a None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:38.900395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:57:38.906512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a53a-9ed2-4290-8ad6-63fd5295b4ff None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:38.906926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a53a-9ed2-4290-8ad6-63fd5295b4ff None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:38.907075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a53a-9ed2-4290-8ad6-63fd5295b4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:38.925720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-7049a53a-9ed2-4290-8ad6-63fd5295b4ff None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:38.926910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7049a53a-9ed2-4290-8ad6-63fd5295b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:38.951957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee825cc8-525c-420a-83d8-0ec956985d12 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:38.952248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee825cc8-525c-420a-83d8-0ec956985d12 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:38.952534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee825cc8-525c-420a-83d8-0ec956985d12 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:38.953859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:57:38.959326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178730-426d-4ad6-bb02-fb6a2a9c2a9c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:38.959608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178730-426d-4ad6-bb02-fb6a2a9c2a9c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:38.960476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178730-426d-4ad6-bb02-fb6a2a9c2a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:39.003047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG passlib.handlers.bcrypt [None req-88178730-426d-4ad6-bb02-fb6a2a9c2a9c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81774) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 11:57:39.003429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG passlib.handlers.bcrypt [None req-88178730-426d-4ad6-bb02-fb6a2a9c2a9c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81774) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 11:57:39.021360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:39.053098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-88178730-426d-4ad6-bb02-fb6a2a9c2a9c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:39.054763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-88178730-426d-4ad6-bb02-fb6a2a9c2a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:39.156911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:57:39.306472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049a53a-9ed2-4290-8ad6-63fd5295b4ff None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:39.332105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:39.409938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049a53a-9ed2-4290-8ad6-63fd5295b4ff None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:39.430769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88178730-426d-4ad6-bb02-fb6a2a9c2a9c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:39.444922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a3380-cf65-4b8e-bfc9-9ebb7343fa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:39.445572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a3380-cf65-4b8e-bfc9-9ebb7343fa31 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:39.445877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a3380-cf65-4b8e-bfc9-9ebb7343fa31 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:39.446133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a3380-cf65-4b8e-bfc9-9ebb7343fa31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:39.457727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a3380-cf65-4b8e-bfc9-9ebb7343fa31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-3f0a3380-cf65-4b8e-bfc9-9ebb7343fa31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:57:39.466582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:57:39.467738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:57:39.468796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:57:39.475604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a3380-cf65-4b8e-bfc9-9ebb7343fa31 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:39.532742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88178730-426d-4ad6-bb02-fb6a2a9c2a9c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:39.535105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:39.564604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:39.578275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f04d33-44fd-484f-a47d-25e4860204ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:39.579137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f04d33-44fd-484f-a47d-25e4860204ee None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:39.579417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f04d33-44fd-484f-a47d-25e4860204ee None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:39.579796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f04d33-44fd-484f-a47d-25e4860204ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:39.583089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a3380-cf65-4b8e-bfc9-9ebb7343fa31 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:39.616868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37184cd4-fe2f-45f6-a22d-8d548a173a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:39.617481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37184cd4-fe2f-45f6-a22d-8d548a173a7a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:39.617761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37184cd4-fe2f-45f6-a22d-8d548a173a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:39.618033 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37184cd4-fe2f-45f6-a22d-8d548a173a7a None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:39.618691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37184cd4-fe2f-45f6-a22d-8d548a173a7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:39.618992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37184cd4-fe2f-45f6-a22d-8d548a173a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:39.620410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37184cd4-fe2f-45f6-a22d-8d548a173a7a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:39.633021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:57:39.638745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37184cd4-fe2f-45f6-a22d-8d548a173a7a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:39.648315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f04d33-44fd-484f-a47d-25e4860204ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:39.649949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f04d33-44fd-484f-a47d-25e4860204ee None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:39.736407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37184cd4-fe2f-45f6-a22d-8d548a173a7a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:39.748358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:57:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:57:39.754099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f04d33-44fd-484f-a47d-25e4860204ee None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:39.757634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:39.770871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022879c-178e-4eee-b12d-0450c5aed7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:39.771509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022879c-178e-4eee-b12d-0450c5aed7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:39.771831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022879c-178e-4eee-b12d-0450c5aed7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:39.772109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022879c-178e-4eee-b12d-0450c5aed7e8 None admin] PATH_INFO: `/v3/users/e0d78cac7890401997b98a7dab7b659c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:39.779802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022879c-178e-4eee-b12d-0450c5aed7e8 None admin] RBAC: Authorizing `identity:get_user(user_id=e0d78cac7890401997b98a7dab7b659c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:39.779802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022879c-178e-4eee-b12d-0450c5aed7e8 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:39.779802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:57:39 2022] GET /identity/v3/users/e0d78cac7890401997b98a7dab7b659c => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:57:39.781881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022879c-178e-4eee-b12d-0450c5aed7e8 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:39.798238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:39.858800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f04d33-44fd-484f-a47d-25e4860204ee None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:39.884586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022879c-178e-4eee-b12d-0450c5aed7e8 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:39.892896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21fed1-283c-4a54-833a-693fed4c544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:39.893766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21fed1-283c-4a54-833a-693fed4c544b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:39.894043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21fed1-283c-4a54-833a-693fed4c544b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:39.894388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21fed1-283c-4a54-833a-693fed4c544b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:39.913296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21fed1-283c-4a54-833a-693fed4c544b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:39.914743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21fed1-283c-4a54-833a-693fed4c544b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:39.920064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5ca22-8f2e-4a36-a86f-f4022efa4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:39.920706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5ca22-8f2e-4a36-a86f-f4022efa4eec None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:39.922971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5ca22-8f2e-4a36-a86f-f4022efa4eec None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:39.922971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5ca22-8f2e-4a36-a86f-f4022efa4eec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:39.922971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5ca22-8f2e-4a36-a86f-f4022efa4eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:39.923863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5ca22-8f2e-4a36-a86f-f4022efa4eec None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:39.925403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:57:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:57:39.932068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5ca22-8f2e-4a36-a86f-f4022efa4eec None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-aa21fed1-283c-4a54-833a-693fed4c544b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:57:39.934465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:57:39.935337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:57:39.936215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:57:39.936215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:57:39.936215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:57:39.936215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:57:39.941383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21fed1-283c-4a54-833a-693fed4c544b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:39.997562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:40.015532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:40.035446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5ca22-8f2e-4a36-a86f-f4022efa4eec None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:40.043339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21fed1-283c-4a54-833a-693fed4c544b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:40.070191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8555925-2cde-4e5a-a98a-48329ab44f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:40.070897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555925-2cde-4e5a-a98a-48329ab44f03 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:40.071183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555925-2cde-4e5a-a98a-48329ab44f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:40.071459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555925-2cde-4e5a-a98a-48329ab44f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:40.072218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8555925-2cde-4e5a-a98a-48329ab44f03 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.domain.id=default, user.id=e0d78cac7890401997b98a7dab7b659c) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:40.072545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8555925-2cde-4e5a-a98a-48329ab44f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:40.073956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8555925-2cde-4e5a-a98a-48329ab44f03 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:40.077886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32501-72a6-41e3-93f2-06c8435381a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:40.078771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32501-72a6-41e3-93f2-06c8435381a5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:40.078771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32501-72a6-41e3-93f2-06c8435381a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:40.079475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32501-72a6-41e3-93f2-06c8435381a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:40.079710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32501-72a6-41e3-93f2-06c8435381a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:40.080017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32501-72a6-41e3-93f2-06c8435381a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:40.081506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32501-72a6-41e3-93f2-06c8435381a5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:40.082367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Sep 9 11:57:39 2022] GET /identity/v3/role_assignments?user.id=e0d78cac7890401997b98a7dab7b659c&scope.domain.id=default&role.id=06592016669243d99b430c46dd1c1d46 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:57:40.100779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:57:42.332517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f0429-915b-4681-ad6e-fcfff204c754 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:42.333042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f0429-915b-4681-ad6e-fcfff204c754 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:42.333123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f0429-915b-4681-ad6e-fcfff204c754 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:42.334411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:42.340482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab900d4-4998-405a-800d-c7941bea2777 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:42.340912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab900d4-4998-405a-800d-c7941bea2777 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:42.341101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab900d4-4998-405a-800d-c7941bea2777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:42.368759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-bab900d4-4998-405a-800d-c7941bea2777 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:42.370012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bab900d4-4998-405a-800d-c7941bea2777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:42.454500 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:57:42.976338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f0429-915b-4681-ad6e-fcfff204c754 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:43.127127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f0429-915b-4681-ad6e-fcfff204c754 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:43.132305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8090-9a19-4708-8213-ecfa5042f558 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.132596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8090-9a19-4708-8213-ecfa5042f558 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.132872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8090-9a19-4708-8213-ecfa5042f558 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.134213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:57:43.145127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126282-620f-4584-88b4-e6138e7e6725 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.145447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126282-620f-4584-88b4-e6138e7e6725 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.145686 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126282-620f-4584-88b4-e6138e7e6725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.173279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b9126282-620f-4584-88b4-e6138e7e6725 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:43.174476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b9126282-620f-4584-88b4-e6138e7e6725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:43.201145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ba76-f102-4a68-862f-71f09b414ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:43.201789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ba76-f102-4a68-862f-71f09b414ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.202069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ba76-f102-4a68-862f-71f09b414ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.202342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ba76-f102-4a68-862f-71f09b414ab3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.223773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77ba76-f102-4a68-862f-71f09b414ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-0d77ba76-f102-4a68-862f-71f09b414ab3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:57:43.229182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:57:43.230043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:57:43.230766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 13/25] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:57:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:57:43.231375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ed75-4af9-41bd-9eed-98a456c88447 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.242550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ed75-4af9-41bd-9eed-98a456c88447 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.242812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ed75-4af9-41bd-9eed-98a456c88447 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.244564 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 14/26] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:43.245321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025ed75-4af9-41bd-9eed-98a456c88447 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:43.258008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:43.269577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:43.302810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 13/27] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:43.305624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25997f-7f64-47b0-9c43-be2b180c08d4 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.306249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25997f-7f64-47b0-9c43-be2b180c08d4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.306249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25997f-7f64-47b0-9c43-be2b180c08d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.339899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8c25997f-7f64-47b0-9c43-be2b180c08d4 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:43.341122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8c25997f-7f64-47b0-9c43-be2b180c08d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:43.435545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025ed75-4af9-41bd-9eed-98a456c88447 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:43.477076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 14/28] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:43.478352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8dac-6bf5-4114-a2b2-8204a68bcdf3 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.478644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8dac-6bf5-4114-a2b2-8204a68bcdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.478927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8dac-6bf5-4114-a2b2-8204a68bcdf3 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.480271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 15/29] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:43.485860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fa67f-e9a4-474b-ac40-6f30e8081fc3 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.486151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fa67f-e9a4-474b-ac40-6f30e8081fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.486414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fa67f-e9a4-474b-ac40-6f30e8081fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.506475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b00431-7b8b-4e1b-90f8-4965cd6d2278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:43.507120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b00431-7b8b-4e1b-90f8-4965cd6d2278 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.507404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b00431-7b8b-4e1b-90f8-4965cd6d2278 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.507710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b00431-7b8b-4e1b-90f8-4965cd6d2278 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.508387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b00431-7b8b-4e1b-90f8-4965cd6d2278 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:43.508696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b00431-7b8b-4e1b-90f8-4965cd6d2278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:43.510104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b00431-7b8b-4e1b-90f8-4965cd6d2278 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:43.522599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-374fa67f-e9a4-474b-ac40-6f30e8081fc3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:43.523845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-374fa67f-e9a4-474b-ac40-6f30e8081fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:43.526975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 15/30] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:43.533576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b00431-7b8b-4e1b-90f8-4965cd6d2278 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:43.610998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:43.649772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b00431-7b8b-4e1b-90f8-4965cd6d2278 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:43.662404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 16/31] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:43.663845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fa67f-e9a4-474b-ac40-6f30e8081fc3 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:43.720455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:43.735739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624cd01-6dfc-46c6-a0b0-1372d1d5ed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:43.736314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624cd01-6dfc-46c6-a0b0-1372d1d5ed3c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.736597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624cd01-6dfc-46c6-a0b0-1372d1d5ed3c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.736901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624cd01-6dfc-46c6-a0b0-1372d1d5ed3c None admin] PATH_INFO: `/v3/users/e0d78cac7890401997b98a7dab7b659c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.738042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624cd01-6dfc-46c6-a0b0-1372d1d5ed3c None admin] RBAC: Authorizing `identity:get_user(user_id=e0d78cac7890401997b98a7dab7b659c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:43.739504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624cd01-6dfc-46c6-a0b0-1372d1d5ed3c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:43.741873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 16/32] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:57:43 2022] GET /identity/v3/users/e0d78cac7890401997b98a7dab7b659c => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:57:43.747908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624cd01-6dfc-46c6-a0b0-1372d1d5ed3c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:43.771256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fa67f-e9a4-474b-ac40-6f30e8081fc3 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:43.808178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf136a97-653b-4a7d-9b73-a6cfaf302902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:43.808964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf136a97-653b-4a7d-9b73-a6cfaf302902 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:43.810666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf136a97-653b-4a7d-9b73-a6cfaf302902 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:43.810666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf136a97-653b-4a7d-9b73-a6cfaf302902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:43.823002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf136a97-653b-4a7d-9b73-a6cfaf302902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:43.824804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf136a97-653b-4a7d-9b73-a6cfaf302902 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-bf136a97-653b-4a7d-9b73-a6cfaf302902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:57:43.841391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:57:43.842348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:57:43.843123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:57:43.843123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:57:43.843123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:57:43.843123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 17/33] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:57:43.855050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf136a97-653b-4a7d-9b73-a6cfaf302902 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:43.988421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:43.991962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624cd01-6dfc-46c6-a0b0-1372d1d5ed3c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:43.999820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf136a97-653b-4a7d-9b73-a6cfaf302902 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:44.038393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1612535-49cc-423c-a5bd-3d0c80cb708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:44.039032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1612535-49cc-423c-a5bd-3d0c80cb708a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.039789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1612535-49cc-423c-a5bd-3d0c80cb708a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.040402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1612535-49cc-423c-a5bd-3d0c80cb708a None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.041467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1612535-49cc-423c-a5bd-3d0c80cb708a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:44.041866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1612535-49cc-423c-a5bd-3d0c80cb708a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:44.047669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1612535-49cc-423c-a5bd-3d0c80cb708a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:44.051570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3bd22-0d2d-4a12-93b6-80444917bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:44.052586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3bd22-0d2d-4a12-93b6-80444917bfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.053048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3bd22-0d2d-4a12-93b6-80444917bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.053524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3bd22-0d2d-4a12-93b6-80444917bfe0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.058241 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 18/34] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:44.059279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1612535-49cc-423c-a5bd-3d0c80cb708a None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:44.059649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3bd22-0d2d-4a12-93b6-80444917bfe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:44.061439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3bd22-0d2d-4a12-93b6-80444917bfe0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:44.064175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 17/35] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:57:44.065233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3bd22-0d2d-4a12-93b6-80444917bfe0 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:44.070860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:44.182209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1612535-49cc-423c-a5bd-3d0c80cb708a None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:44.182799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3bd22-0d2d-4a12-93b6-80444917bfe0 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:44.218351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7321c0-05b6-47ed-9d58-88483e2d6442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:44.218969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7321c0-05b6-47ed-9d58-88483e2d6442 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.219260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7321c0-05b6-47ed-9d58-88483e2d6442 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.219540 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7321c0-05b6-47ed-9d58-88483e2d6442 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.220411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7321c0-05b6-47ed-9d58-88483e2d6442 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:44.220515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d61c75-0830-4131-b545-fab08f6f986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:44.221032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d61c75-0830-4131-b545-fab08f6f986f None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.221318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d61c75-0830-4131-b545-fab08f6f986f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.221596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d61c75-0830-4131-b545-fab08f6f986f None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.221863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7321c0-05b6-47ed-9d58-88483e2d6442 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:44.222274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d61c75-0830-4131-b545-fab08f6f986f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:44.223774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d61c75-0830-4131-b545-fab08f6f986f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:44.435469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 19/36] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 11:57:44 2022] POST /identity/v3/roles => generated 219 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:57:44.437298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d61c75-0830-4131-b545-fab08f6f986f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:44.460581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:44.461892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 11:57:44 2022] POST /identity/v3/projects => generated 301 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:57:44.463690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7321c0-05b6-47ed-9d58-88483e2d6442 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:44.553329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:44.612328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7321c0-05b6-47ed-9d58-88483e2d6442 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:44.612566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d61c75-0830-4131-b545-fab08f6f986f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:44.658979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c44896-388a-4aaa-a968-67e9a1101ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:44.658979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c44896-388a-4aaa-a968-67e9a1101ed6 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.659272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c44896-388a-4aaa-a968-67e9a1101ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.659492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c44896-388a-4aaa-a968-67e9a1101ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.659844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eef488-8802-41ac-ab09-23c846a7836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:44.660264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c44896-388a-4aaa-a968-67e9a1101ed6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:44.660524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eef488-8802-41ac-ab09-23c846a7836c None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.660804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eef488-8802-41ac-ab09-23c846a7836c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.661081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eef488-8802-41ac-ab09-23c846a7836c None admin] PATH_INFO: `/v3/domains/default/users/e0d78cac7890401997b98a7dab7b659c/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.661785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c44896-388a-4aaa-a968-67e9a1101ed6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:44.663660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eef488-8802-41ac-ab09-23c846a7836c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e0d78cac7890401997b98a7dab7b659c, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:44.665199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eef488-8802-41ac-ab09-23c846a7836c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:44.718072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 19/38] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 11:57:44 2022] POST /identity/v3/roles => generated 225 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:57:44.719385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157c2a0-1dd9-42ce-a9a1-c121242f6cc1 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.719794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157c2a0-1dd9-42ce-a9a1-c121242f6cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.720068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157c2a0-1dd9-42ce-a9a1-c121242f6cc1 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.721432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 20/39] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:44.724743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24955-7806-4c3b-b6a1-99d119894f5f None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.725915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24955-7806-4c3b-b6a1-99d119894f5f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.726413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24955-7806-4c3b-b6a1-99d119894f5f None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.728785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 21/40] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:44.731792 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b79d-04c7-4d04-8f08-f3ba01818893 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.731792 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b79d-04c7-4d04-8f08-f3ba01818893 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.731792 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b79d-04c7-4d04-8f08-f3ba01818893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.732045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 20/41] 10.222.0.27 () {58 vars in 1361 bytes} [Fri Sep 9 11:57:44 2022] PUT /identity/v3/domains/default/users/e0d78cac7890401997b98a7dab7b659c/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:57:44.736287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799e09-244a-4aef-8188-98afc7e07709 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:44.736654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799e09-244a-4aef-8188-98afc7e07709 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:44.737035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799e09-244a-4aef-8188-98afc7e07709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:44.761242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6611b79d-04c7-4d04-8f08-f3ba01818893 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:44.761943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5f799e09-244a-4aef-8188-98afc7e07709 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:44.763684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6611b79d-04c7-4d04-8f08-f3ba01818893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:44.763842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5f799e09-244a-4aef-8188-98afc7e07709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:44.848613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:44.855298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 21/42] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:44.978277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 22/43] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:45.133713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f799e09-244a-4aef-8188-98afc7e07709 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:45.241576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f799e09-244a-4aef-8188-98afc7e07709 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:45.245502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611b79d-04c7-4d04-8f08-f3ba01818893 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:45.279858 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fb8af-81ac-4b50-a50c-e1fff2713d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:45.280514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fb8af-81ac-4b50-a50c-e1fff2713d17 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:45.281400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fb8af-81ac-4b50-a50c-e1fff2713d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:45.281400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fb8af-81ac-4b50-a50c-e1fff2713d17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:45.282485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fb8af-81ac-4b50-a50c-e1fff2713d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:45.283991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fb8af-81ac-4b50-a50c-e1fff2713d17 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:45.285757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 22/44] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:57:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:45.290990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fb8af-81ac-4b50-a50c-e1fff2713d17 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:45.294882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:45.356236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611b79d-04c7-4d04-8f08-f3ba01818893 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:45.361886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:45.393743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a1bc8-1cb1-4308-a6bf-30b49a149391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:45.394362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1bc8-1cb1-4308-a6bf-30b49a149391 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:45.394658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1bc8-1cb1-4308-a6bf-30b49a149391 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:45.394939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1bc8-1cb1-4308-a6bf-30b49a149391 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:45.395639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a1bc8-1cb1-4308-a6bf-30b49a149391 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:45.397016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a1bc8-1cb1-4308-a6bf-30b49a149391 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:45.399167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fb8af-81ac-4b50-a50c-e1fff2713d17 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:45.434247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca41ca-de00-4527-8b80-1e2388b3495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:45.434871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca41ca-de00-4527-8b80-1e2388b3495e None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:45.435156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca41ca-de00-4527-8b80-1e2388b3495e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:45.435436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca41ca-de00-4527-8b80-1e2388b3495e None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:45.436124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca41ca-de00-4527-8b80-1e2388b3495e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:45.437582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca41ca-de00-4527-8b80-1e2388b3495e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:45.501344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 23/45] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 11:57:45 2022] POST /identity/v3/roles => generated 223 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:57:45.531244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 11:57:45 2022] POST /identity/v3/projects => generated 312 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:57:46.991127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd367f-7e83-403c-a6d8-84de150aa7f2 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:46.991678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd367f-7e83-403c-a6d8-84de150aa7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:46.991763 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd367f-7e83-403c-a6d8-84de150aa7f2 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:46.993130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:46.998827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca164-1894-4582-83d2-659b25c30dd9 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:46.999221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca164-1894-4582-83d2-659b25c30dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:46.999462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca164-1894-4582-83d2-659b25c30dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:47.017292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-a31ca164-1894-4582-83d2-659b25c30dd9 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:47.018485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a31ca164-1894-4582-83d2-659b25c30dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:47.084521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:47.357369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd367f-7e83-403c-a6d8-84de150aa7f2 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:47.464709 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd367f-7e83-403c-a6d8-84de150aa7f2 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:47.466987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:47.499447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e49a20-ac04-4565-9e9b-5791b73c4553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:47.500110 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e49a20-ac04-4565-9e9b-5791b73c4553 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:47.500399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e49a20-ac04-4565-9e9b-5791b73c4553 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:47.500677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e49a20-ac04-4565-9e9b-5791b73c4553 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:47.510739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e49a20-ac04-4565-9e9b-5791b73c4553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-c9e49a20-ac04-4565-9e9b-5791b73c4553 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:57:47.515612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:57:47.516601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:57:47.517632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 25/49] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:57:47.523242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca164-1894-4582-83d2-659b25c30dd9 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:47.571328 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:47.625705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca164-1894-4582-83d2-659b25c30dd9 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:47.658824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff2d1-29d4-4824-bf40-6d2f1e9c30bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:47.659435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff2d1-29d4-4824-bf40-6d2f1e9c30bb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:47.659734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff2d1-29d4-4824-bf40-6d2f1e9c30bb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:47.660009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff2d1-29d4-4824-bf40-6d2f1e9c30bb None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:47.660672 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff2d1-29d4-4824-bf40-6d2f1e9c30bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:47.660973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff2d1-29d4-4824-bf40-6d2f1e9c30bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:47.662335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff2d1-29d4-4824-bf40-6d2f1e9c30bb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:47.723060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431e45-e82e-47fe-b137-612cf33f8cf1 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:47.723467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431e45-e82e-47fe-b137-612cf33f8cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:47.723799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431e45-e82e-47fe-b137-612cf33f8cf1 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:47.725195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 26/50] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:57:47.731774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0054-a2ab-460c-aa9c-372bab088410 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:47.732065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0054-a2ab-460c-aa9c-372bab088410 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:47.732339 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0054-a2ab-460c-aa9c-372bab088410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:47.751392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-de6f0054-a2ab-460c-aa9c-372bab088410 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:47.752648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-de6f0054-a2ab-460c-aa9c-372bab088410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:47.777938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 25/51] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:57:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:47.783639 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff2d1-29d4-4824-bf40-6d2f1e9c30bb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:47.821307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 27/52] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:57:47.881187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff2d1-29d4-4824-bf40-6d2f1e9c30bb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:47.894120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:47.916969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41683b-f926-4c80-bfb7-3a9a9aba76e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:47.917604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41683b-f926-4c80-bfb7-3a9a9aba76e8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:47.917890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41683b-f926-4c80-bfb7-3a9a9aba76e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:47.918171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41683b-f926-4c80-bfb7-3a9a9aba76e8 None admin] PATH_INFO: `/v3/users/e0d78cac7890401997b98a7dab7b659c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:47.919310 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41683b-f926-4c80-bfb7-3a9a9aba76e8 None admin] RBAC: Authorizing `identity:get_user(user_id=e0d78cac7890401997b98a7dab7b659c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:47.920806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41683b-f926-4c80-bfb7-3a9a9aba76e8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:47.922902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:57:47 2022] GET /identity/v3/users/e0d78cac7890401997b98a7dab7b659c => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:57:47.927985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f0054-a2ab-460c-aa9c-372bab088410 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:48.033039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:48.040230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f0054-a2ab-460c-aa9c-372bab088410 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:48.074876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26703d-8202-4e6a-8c0c-61e493b9e997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:48.075580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26703d-8202-4e6a-8c0c-61e493b9e997 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:48.075876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26703d-8202-4e6a-8c0c-61e493b9e997 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:48.076153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26703d-8202-4e6a-8c0c-61e493b9e997 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:48.077268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26703d-8202-4e6a-8c0c-61e493b9e997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:48.078720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26703d-8202-4e6a-8c0c-61e493b9e997 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:48.080323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 28/54] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:48.086779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41683b-f926-4c80-bfb7-3a9a9aba76e8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:48.089170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26703d-8202-4e6a-8c0c-61e493b9e997 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:48.189149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41683b-f926-4c80-bfb7-3a9a9aba76e8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:48.197301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26703d-8202-4e6a-8c0c-61e493b9e997 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:48.224412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c9ab-ef59-48fb-99b3-a42d64cec45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:48.225034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c9ab-ef59-48fb-99b3-a42d64cec45b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:48.225318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c9ab-ef59-48fb-99b3-a42d64cec45b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:48.225595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c9ab-ef59-48fb-99b3-a42d64cec45b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:48.226354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c9ab-ef59-48fb-99b3-a42d64cec45b None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.domain.id=default, user.id=e0d78cac7890401997b98a7dab7b659c) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:48.226732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c9ab-ef59-48fb-99b3-a42d64cec45b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:48.228307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c9ab-ef59-48fb-99b3-a42d64cec45b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:48.231241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcefc8-7063-4669-8526-ac83870dbedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:48.231900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcefc8-7063-4669-8526-ac83870dbedf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:48.233221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcefc8-7063-4669-8526-ac83870dbedf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:48.233221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcefc8-7063-4669-8526-ac83870dbedf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:48.233575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcefc8-7063-4669-8526-ac83870dbedf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:48.235005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcefc8-7063-4669-8526-ac83870dbedf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:48.236315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Sep 9 11:57:48 2022] GET /identity/v3/role_assignments?user.id=e0d78cac7890401997b98a7dab7b659c&scope.domain.id=default&role.id=06592016669243d99b430c46dd1c1d46 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:48.236636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 29/56] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:57:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:57:48.245555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c9ab-ef59-48fb-99b3-a42d64cec45b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:48.293974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:48.353507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c9ab-ef59-48fb-99b3-a42d64cec45b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:48.390798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3294b1-dfd9-4e6e-bb70-c538d1b98cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:48.391506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3294b1-dfd9-4e6e-bb70-c538d1b98cc2 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:48.391906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3294b1-dfd9-4e6e-bb70-c538d1b98cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:48.392249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3294b1-dfd9-4e6e-bb70-c538d1b98cc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:48.393045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3294b1-dfd9-4e6e-bb70-c538d1b98cc2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:48.394554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3294b1-dfd9-4e6e-bb70-c538d1b98cc2 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:48.535984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 28/57] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Sep 9 11:57:48 2022] POST /identity/v3/projects => generated 298 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:57:50.706050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c0825-479b-44e4-ab24-c67c2dfc7a9c None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:50.706572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c0825-479b-44e4-ab24-c67c2dfc7a9c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:50.706657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c0825-479b-44e4-ab24-c67c2dfc7a9c None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:50.707985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:50.713612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bfd27-57c5-462c-83e5-d4d514f64320 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:50.714019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bfd27-57c5-462c-83e5-d4d514f64320 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:50.714176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bfd27-57c5-462c-83e5-d4d514f64320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:50.732469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-821bfd27-57c5-462c-83e5-d4d514f64320 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:50.733658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-821bfd27-57c5-462c-83e5-d4d514f64320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:50.797356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:51.067670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c0825-479b-44e4-ab24-c67c2dfc7a9c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:51.098181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:51.176676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c0825-479b-44e4-ab24-c67c2dfc7a9c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:51.210688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e32aa-9dfa-4e80-9735-e57c5c8b2de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:51.211321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e32aa-9dfa-4e80-9735-e57c5c8b2de1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:51.211602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e32aa-9dfa-4e80-9735-e57c5c8b2de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:51.211903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e32aa-9dfa-4e80-9735-e57c5c8b2de1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:51.213009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e32aa-9dfa-4e80-9735-e57c5c8b2de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:51.214432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e32aa-9dfa-4e80-9735-e57c5c8b2de1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:51.216024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:57:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:51.221523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bfd27-57c5-462c-83e5-d4d514f64320 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:51.244620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:51.315846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bfd27-57c5-462c-83e5-d4d514f64320 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:51.349204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fb11b-d6ea-40ed-8567-1e4c54ecb001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:51.349746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fb11b-d6ea-40ed-8567-1e4c54ecb001 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:51.350031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fb11b-d6ea-40ed-8567-1e4c54ecb001 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:51.350309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fb11b-d6ea-40ed-8567-1e4c54ecb001 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:51.351546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fb11b-d6ea-40ed-8567-1e4c54ecb001 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:51.353016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fb11b-d6ea-40ed-8567-1e4c54ecb001 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:51.443315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:57:51 2022] POST /identity/v3/users => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:57:54.872198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d36bfe-76e4-4d1e-89cd-b78576483ffa None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:54.873521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d36bfe-76e4-4d1e-89cd-b78576483ffa None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:54.874023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d36bfe-76e4-4d1e-89cd-b78576483ffa None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:54.875667 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:54.882234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b16390-8bd1-4b16-bcb3-3b2538f534ee None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:54.883158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b16390-8bd1-4b16-bcb3-3b2538f534ee None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:54.883657 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b16390-8bd1-4b16-bcb3-3b2538f534ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:54.916753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-01b16390-8bd1-4b16-bcb3-3b2538f534ee None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:54.917977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-01b16390-8bd1-4b16-bcb3-3b2538f534ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:54.986633 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf404fd-6619-4bd4-8a53-c196529c6cee None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:54.987258 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf404fd-6619-4bd4-8a53-c196529c6cee None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:54.987789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf404fd-6619-4bd4-8a53-c196529c6cee None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:54.989361 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 33/63] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:54.995521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b01e-2874-4154-b0ea-1d3d67f3d8d6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:54.996304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b01e-2874-4154-b0ea-1d3d67f3d8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:54.996976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b01e-2874-4154-b0ea-1d3d67f3d8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.021648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 31/64] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:55.032821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d006b01e-2874-4154-b0ea-1d3d67f3d8d6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:55.034065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d006b01e-2874-4154-b0ea-1d3d67f3d8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:55.149663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 34/65] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:55.242692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beb033-1994-4727-b834-48da7c7ab9d2 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.243032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beb033-1994-4727-b834-48da7c7ab9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.243254 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beb033-1994-4727-b834-48da7c7ab9d2 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.244976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 32/66] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:55.251285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71dce2-ba03-4cd4-97ef-8e084fc66a30 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.251584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71dce2-ba03-4cd4-97ef-8e084fc66a30 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.251897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71dce2-ba03-4cd4-97ef-8e084fc66a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.275785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ac71dce2-ba03-4cd4-97ef-8e084fc66a30 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:55.277000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ac71dce2-ba03-4cd4-97ef-8e084fc66a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:55.310541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:55.343982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beb033-1994-4727-b834-48da7c7ab9d2 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:55.360313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:55.387907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 35/67] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:55.393846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18687813-5ee4-4fd0-8158-332defd2b7e7 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.394182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18687813-5ee4-4fd0-8158-332defd2b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.394616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18687813-5ee4-4fd0-8158-332defd2b7e7 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.395825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 36/68] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:55.405663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71929096-5be8-4e45-99a3-1e7bf72dd9b8 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.405663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71929096-5be8-4e45-99a3-1e7bf72dd9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.405663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71929096-5be8-4e45-99a3-1e7bf72dd9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.429880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-71929096-5be8-4e45-99a3-1e7bf72dd9b8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:55.431538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-71929096-5be8-4e45-99a3-1e7bf72dd9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:55.482580 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beb033-1994-4727-b834-48da7c7ab9d2 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:55.539708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8b826-a267-4bc4-93cf-b2a4f84ea72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:55.540349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b826-a267-4bc4-93cf-b2a4f84ea72f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.540634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b826-a267-4bc4-93cf-b2a4f84ea72f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.540913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b826-a267-4bc4-93cf-b2a4f84ea72f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.547292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 37/69] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:55.548412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71929096-5be8-4e45-99a3-1e7bf72dd9b8 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:55.555375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8b826-a267-4bc4-93cf-b2a4f84ea72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-abd8b826-a267-4bc4-93cf-b2a4f84ea72f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:57:55.562274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:57:55.563118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:57:55.563901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 33/70] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:57:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:57:55.564918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d35cb-19eb-46d4-8de6-0fa21dd4b06c None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.565343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d35cb-19eb-46d4-8de6-0fa21dd4b06c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.565759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d35cb-19eb-46d4-8de6-0fa21dd4b06c None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.567116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 34/71] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:55.570018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d35cb-19eb-46d4-8de6-0fa21dd4b06c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:55.652076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:55.657416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:55.675673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71929096-5be8-4e45-99a3-1e7bf72dd9b8 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:55.689804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d35cb-19eb-46d4-8de6-0fa21dd4b06c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:55.710545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45ebc2-385f-4959-988b-1efdefaccb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:55.711198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ebc2-385f-4959-988b-1efdefaccb4e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.711844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ebc2-385f-4959-988b-1efdefaccb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.712578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ebc2-385f-4959-988b-1efdefaccb4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.723772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45ebc2-385f-4959-988b-1efdefaccb4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:57:55.724661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09699542-9784-46fd-8b6b-cf60cce65f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:55.725281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09699542-9784-46fd-8b6b-cf60cce65f6f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.726129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09699542-9784-46fd-8b6b-cf60cce65f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.726410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09699542-9784-46fd-8b6b-cf60cce65f6f None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.727086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09699542-9784-46fd-8b6b-cf60cce65f6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:55.727395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09699542-9784-46fd-8b6b-cf60cce65f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:55.728837 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09699542-9784-46fd-8b6b-cf60cce65f6f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-3e45ebc2-385f-4959-988b-1efdefaccb4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:57:55.729577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:57:55.730371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:57:55.731114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 38/72] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:57:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:57:55.732220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ba37-b048-45e6-95aa-209fbbeb623b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.732220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ba37-b048-45e6-95aa-209fbbeb623b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.732504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ba37-b048-45e6-95aa-209fbbeb623b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.749288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 35/73] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:55.749288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09699542-9784-46fd-8b6b-cf60cce65f6f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:55.755712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-9d20ba37-b048-45e6-95aa-209fbbeb623b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:55.756948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9d20ba37-b048-45e6-95aa-209fbbeb623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:55.824517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 39/74] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:55.825566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20ba37-b048-45e6-95aa-209fbbeb623b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:55.858124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09699542-9784-46fd-8b6b-cf60cce65f6f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:55.896604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:55.903482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12093db-6518-40d5-b57c-64bcc215ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:55.904733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12093db-6518-40d5-b57c-64bcc215ebab None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.905029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12093db-6518-40d5-b57c-64bcc215ebab None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.911987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12093db-6518-40d5-b57c-64bcc215ebab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.917672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:55.918313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12093db-6518-40d5-b57c-64bcc215ebab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-d12093db-6518-40d5-b57c-64bcc215ebab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:57:55.923559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:57:55.924728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 36/75] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:57:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:57:55.930928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12093db-6518-40d5-b57c-64bcc215ebab None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:55.951352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20ba37-b048-45e6-95aa-209fbbeb623b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:55.988479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4337-3838-49a0-b5e4-2d5d4055ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:55.989096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4337-3838-49a0-b5e4-2d5d4055ef52 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:55.989380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4337-3838-49a0-b5e4-2d5d4055ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:55.989656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4337-3838-49a0-b5e4-2d5d4055ef52 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:55.990319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d4337-3838-49a0-b5e4-2d5d4055ef52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:55.990628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d4337-3838-49a0-b5e4-2d5d4055ef52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:55.992087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d4337-3838-49a0-b5e4-2d5d4055ef52 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:56.000474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 40/76] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:57:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:56.001278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4337-3838-49a0-b5e4-2d5d4055ef52 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.041917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12093db-6518-40d5-b57c-64bcc215ebab None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.079435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb86b7-a846-4f8d-a99a-c03691be46fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.080484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb86b7-a846-4f8d-a99a-c03691be46fa None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.080935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb86b7-a846-4f8d-a99a-c03691be46fa None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.081477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb86b7-a846-4f8d-a99a-c03691be46fa None admin] PATH_INFO: `/v3/users/e0d78cac7890401997b98a7dab7b659c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.082780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb86b7-a846-4f8d-a99a-c03691be46fa None admin] RBAC: Authorizing `identity:get_user(user_id=e0d78cac7890401997b98a7dab7b659c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:56.085220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb86b7-a846-4f8d-a99a-c03691be46fa None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:56.087055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 37/77] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:57:55 2022] GET /identity/v3/users/e0d78cac7890401997b98a7dab7b659c => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:56.088088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb86b7-a846-4f8d-a99a-c03691be46fa None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.108356 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4337-3838-49a0-b5e4-2d5d4055ef52 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.142904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc4f2-ed88-4f0e-8f82-d178613a1ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.143533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc4f2-ed88-4f0e-8f82-d178613a1ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.143839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc4f2-ed88-4f0e-8f82-d178613a1ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.144112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc4f2-ed88-4f0e-8f82-d178613a1ca8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.145222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc4f2-ed88-4f0e-8f82-d178613a1ca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:56.146647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc4f2-ed88-4f0e-8f82-d178613a1ca8 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:56.148810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 41/78] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:57:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:56.149564 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc4f2-ed88-4f0e-8f82-d178613a1ca8 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.158716 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:56.160997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:56.198456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb86b7-a846-4f8d-a99a-c03691be46fa None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.231645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f204-0273-4555-9bb0-941b95e5f065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.232383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f204-0273-4555-9bb0-941b95e5f065 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.232675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f204-0273-4555-9bb0-941b95e5f065 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.232952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f204-0273-4555-9bb0-941b95e5f065 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.233621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807f204-0273-4555-9bb0-941b95e5f065 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:56.233934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807f204-0273-4555-9bb0-941b95e5f065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:56.235296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807f204-0273-4555-9bb0-941b95e5f065 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:56.243369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 38/79] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:57:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:56.244029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f204-0273-4555-9bb0-941b95e5f065 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.253551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc4f2-ed88-4f0e-8f82-d178613a1ca8 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.288012 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c10ab0-a75e-4328-b781-31d69bde25f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.288660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c10ab0-a75e-4328-b781-31d69bde25f5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.288948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c10ab0-a75e-4328-b781-31d69bde25f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.289229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c10ab0-a75e-4328-b781-31d69bde25f5 None admin] PATH_INFO: `/v3/users/a1274ffcf97a4e5db55bf956186d0e54` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.302708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c10ab0-a75e-4328-b781-31d69bde25f5 None admin] RBAC: Authorizing `identity:get_user(user_id=a1274ffcf97a4e5db55bf956186d0e54)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:56.304223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c10ab0-a75e-4328-b781-31d69bde25f5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:56.305838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 42/80] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:57:56 2022] GET /identity/v3/users/a1274ffcf97a4e5db55bf956186d0e54 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:56.306609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c10ab0-a75e-4328-b781-31d69bde25f5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.345558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f204-0273-4555-9bb0-941b95e5f065 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.370178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:56.372140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:56.382517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d47202-1540-44ea-9882-5e308476a655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.383138 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47202-1540-44ea-9882-5e308476a655 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.383429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47202-1540-44ea-9882-5e308476a655 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.383744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47202-1540-44ea-9882-5e308476a655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.406948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c10ab0-a75e-4328-b781-31d69bde25f5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.441184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6682aa0-7639-4943-b70c-4cf388f6079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.441829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6682aa0-7639-4943-b70c-4cf388f6079d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.442114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6682aa0-7639-4943-b70c-4cf388f6079d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.442389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6682aa0-7639-4943-b70c-4cf388f6079d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.453018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6682aa0-7639-4943-b70c-4cf388f6079d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:57:56.457140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d47202-1540-44ea-9882-5e308476a655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-f6682aa0-7639-4943-b70c-4cf388f6079d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:57:56.457701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:57:56.458565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:57:56.459306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:57:56.460466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d47202-1540-44ea-9882-5e308476a655 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:56.461013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 43/81] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:57:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:57:56.461013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6682aa0-7639-4943-b70c-4cf388f6079d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.555338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 39/82] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:57:56.556237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d47202-1540-44ea-9882-5e308476a655 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.563472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6682aa0-7639-4943-b70c-4cf388f6079d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.579544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:56.590580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:56.599224 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc91329-b946-4dea-b36d-fa4f8769ca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.599861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc91329-b946-4dea-b36d-fa4f8769ca62 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.600146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc91329-b946-4dea-b36d-fa4f8769ca62 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.600467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc91329-b946-4dea-b36d-fa4f8769ca62 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.601127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc91329-b946-4dea-b36d-fa4f8769ca62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:56.602591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc91329-b946-4dea-b36d-fa4f8769ca62 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:56.654417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d47202-1540-44ea-9882-5e308476a655 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.677118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 44/83] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:57:56 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:57:56.677963 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc91329-b946-4dea-b36d-fa4f8769ca62 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.690747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91962e96-3b67-4ea5-ade1-de60bc15adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.691526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91962e96-3b67-4ea5-ade1-de60bc15adde None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.691910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91962e96-3b67-4ea5-ade1-de60bc15adde None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.692212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91962e96-3b67-4ea5-ade1-de60bc15adde None admin] PATH_INFO: `/v3/users/a1274ffcf97a4e5db55bf956186d0e54` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.693447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91962e96-3b67-4ea5-ade1-de60bc15adde None admin] RBAC: Authorizing `identity:get_user(user_id=a1274ffcf97a4e5db55bf956186d0e54)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:56.696612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91962e96-3b67-4ea5-ade1-de60bc15adde None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:56.699133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 40/84] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:57:56 2022] GET /identity/v3/users/a1274ffcf97a4e5db55bf956186d0e54 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:56.699940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91962e96-3b67-4ea5-ade1-de60bc15adde None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.797293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc91329-b946-4dea-b36d-fa4f8769ca62 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.808520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:56.819931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91962e96-3b67-4ea5-ade1-de60bc15adde None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:56.835972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763cf1-397d-4d64-8af1-60ba72709f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.836671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763cf1-397d-4d64-8af1-60ba72709f2e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.836956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763cf1-397d-4d64-8af1-60ba72709f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.837231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763cf1-397d-4d64-8af1-60ba72709f2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.864124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d49e-ddf0-4a33-8432-f73c749bd4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:56.864654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d49e-ddf0-4a33-8432-f73c749bd4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:56.865621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d49e-ddf0-4a33-8432-f73c749bd4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:56.865621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d49e-ddf0-4a33-8432-f73c749bd4f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:56.865851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d49e-ddf0-4a33-8432-f73c749bd4f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:56.866689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d49e-ddf0-4a33-8432-f73c749bd4f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:56.868073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817d49e-ddf0-4a33-8432-f73c749bd4f4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:56.878122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 41/85] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:57:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:56.878865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d49e-ddf0-4a33-8432-f73c749bd4f4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:56.896628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:56.918461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763cf1-397d-4d64-8af1-60ba72709f2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:56.921674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763cf1-397d-4d64-8af1-60ba72709f2e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:57.007593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d49e-ddf0-4a33-8432-f73c749bd4f4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:57.050136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597875d0-4a87-4067-82ee-6701fd7b51fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:57.050700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597875d0-4a87-4067-82ee-6701fd7b51fa None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:57.050988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597875d0-4a87-4067-82ee-6701fd7b51fa None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:57.051271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597875d0-4a87-4067-82ee-6701fd7b51fa None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:57.052495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597875d0-4a87-4067-82ee-6701fd7b51fa None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:57.053994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597875d0-4a87-4067-82ee-6701fd7b51fa None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:57.056499 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 42/86] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:57:56 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:57.056618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597875d0-4a87-4067-82ee-6701fd7b51fa None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:57.083075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:57.083831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 45/87] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:57:57.085527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763cf1-397d-4d64-8af1-60ba72709f2e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:57.190329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597875d0-4a87-4067-82ee-6701fd7b51fa None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:57.198099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:57.220308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763cf1-397d-4d64-8af1-60ba72709f2e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:57.238524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c81a4-e633-4faa-b1c4-416e003c866b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:57.239231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c81a4-e633-4faa-b1c4-416e003c866b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:57.239584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c81a4-e633-4faa-b1c4-416e003c866b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:57.239974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c81a4-e633-4faa-b1c4-416e003c866b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:57.263008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4040-f636-4040-a553-686f150a6f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:57.263672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4040-f636-4040-a553-686f150a6f42 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:57.264177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4040-f636-4040-a553-686f150a6f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:57.264765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4040-f636-4040-a553-686f150a6f42 None admin] PATH_INFO: `/v3/users/a1274ffcf97a4e5db55bf956186d0e54` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:57.266682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4040-f636-4040-a553-686f150a6f42 None admin] RBAC: Authorizing `identity:get_user(user_id=a1274ffcf97a4e5db55bf956186d0e54)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:57.268864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4040-f636-4040-a553-686f150a6f42 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:57.270771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 46/88] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:57:57 2022] GET /identity/v3/users/a1274ffcf97a4e5db55bf956186d0e54 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:57.271544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4040-f636-4040-a553-686f150a6f42 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:57.324236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c81a4-e633-4faa-b1c4-416e003c866b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:57.326002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c81a4-e633-4faa-b1c4-416e003c866b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:57.349300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:57.390760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4040-f636-4040-a553-686f150a6f42 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:57.427704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd363a-231d-45fc-9aa7-a550b891e8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:57.429193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd363a-231d-45fc-9aa7-a550b891e8cf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:57.429581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd363a-231d-45fc-9aa7-a550b891e8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:57.429958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd363a-231d-45fc-9aa7-a550b891e8cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:57.430911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd363a-231d-45fc-9aa7-a550b891e8cf None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=9078564600ac4355acf60302d36d426d, user.id=e0d78cac7890401997b98a7dab7b659c) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:57.431420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd363a-231d-45fc-9aa7-a550b891e8cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:57.433047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd363a-231d-45fc-9aa7-a550b891e8cf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:57.435033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 43/89] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:57:57.435934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c81a4-e633-4faa-b1c4-416e003c866b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:57.439722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 47/90] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:57:57 2022] GET /identity/v3/role_assignments?user.id=e0d78cac7890401997b98a7dab7b659c&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=06592016669243d99b430c46dd1c1d46 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:57.440714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd363a-231d-45fc-9aa7-a550b891e8cf None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:57.492052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:57.552798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c81a4-e633-4faa-b1c4-416e003c866b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:57.576256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:57.591181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da45827-b80f-4d3c-84b3-4e1014712b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:57.591874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da45827-b80f-4d3c-84b3-4e1014712b3c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:57.592159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da45827-b80f-4d3c-84b3-4e1014712b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:57.596044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da45827-b80f-4d3c-84b3-4e1014712b3c None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:57.596044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da45827-b80f-4d3c-84b3-4e1014712b3c None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:57.596044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da45827-b80f-4d3c-84b3-4e1014712b3c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:57.597220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 44/91] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:57:57 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:57.598345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da45827-b80f-4d3c-84b3-4e1014712b3c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:57.622172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd363a-231d-45fc-9aa7-a550b891e8cf None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:57.705559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b81b04-1470-46cd-9c9a-2c8188fcc901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:57.706234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b81b04-1470-46cd-9c9a-2c8188fcc901 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:57.706591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b81b04-1470-46cd-9c9a-2c8188fcc901 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:57.706869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b81b04-1470-46cd-9c9a-2c8188fcc901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:57.716398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da45827-b80f-4d3c-84b3-4e1014712b3c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:57.757893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4b01c-7d1c-41b9-8a23-93f2caf1b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:57.758544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4b01c-7d1c-41b9-8a23-93f2caf1b671 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:57.758827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4b01c-7d1c-41b9-8a23-93f2caf1b671 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:57.759103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4b01c-7d1c-41b9-8a23-93f2caf1b671 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:57.760325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4b01c-7d1c-41b9-8a23-93f2caf1b671 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:57.762113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4b01c-7d1c-41b9-8a23-93f2caf1b671 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:57.764213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 45/92] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:57:57 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:57.764838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4b01c-7d1c-41b9-8a23-93f2caf1b671 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:57.837612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:57.841145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b81b04-1470-46cd-9c9a-2c8188fcc901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:57.846376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b81b04-1470-46cd-9c9a-2c8188fcc901 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:57.868016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:57.891116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4b01c-7d1c-41b9-8a23-93f2caf1b671 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:57.941278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db0c29-dc2f-43a4-952e-adc1c134d362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:57.941905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db0c29-dc2f-43a4-952e-adc1c134d362 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:57.942189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db0c29-dc2f-43a4-952e-adc1c134d362 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:57.942464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db0c29-dc2f-43a4-952e-adc1c134d362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:57.943738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db0c29-dc2f-43a4-952e-adc1c134d362 None admin] RBAC: Adding query filter params (role.id=df79e12324de40afbb353b95363811cc, scope.project.id=9078564600ac4355acf60302d36d426d, user.id=a1274ffcf97a4e5db55bf956186d0e54) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:57.943915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db0c29-dc2f-43a4-952e-adc1c134d362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:57.946022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db0c29-dc2f-43a4-952e-adc1c134d362 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:57.951757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 46/93] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:57:57 2022] GET /identity/v3/role_assignments?user.id=a1274ffcf97a4e5db55bf956186d0e54&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=df79e12324de40afbb353b95363811cc => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:57.952720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db0c29-dc2f-43a4-952e-adc1c134d362 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:58.082759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 48/94] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:57:58.089852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b81b04-1470-46cd-9c9a-2c8188fcc901 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:58.164233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db0c29-dc2f-43a4-952e-adc1c134d362 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:58.229877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:58.266012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848ab9b-4396-4cd5-b4bc-df5e1fad4bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:58.266660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848ab9b-4396-4cd5-b4bc-df5e1fad4bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:58.266958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848ab9b-4396-4cd5-b4bc-df5e1fad4bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:58.267240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848ab9b-4396-4cd5-b4bc-df5e1fad4bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:58.268304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848ab9b-4396-4cd5-b4bc-df5e1fad4bd0 None admin] RBAC: Adding query filter params (role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=9078564600ac4355acf60302d36d426d, user.id=a1274ffcf97a4e5db55bf956186d0e54) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:58.268627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848ab9b-4396-4cd5-b4bc-df5e1fad4bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:58.270535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848ab9b-4396-4cd5-b4bc-df5e1fad4bd0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:58.283753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 47/95] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:57:57 2022] GET /identity/v3/role_assignments?user.id=a1274ffcf97a4e5db55bf956186d0e54&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=1387b2da4fc147fe99310c8bea8504be => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:58.330923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b81b04-1470-46cd-9c9a-2c8188fcc901 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:58.351549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:58.380555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed4ba3-9849-4cbb-a820-b188e62c521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:58.381570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed4ba3-9849-4cbb-a820-b188e62c521a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:58.382634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed4ba3-9849-4cbb-a820-b188e62c521a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:58.383104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed4ba3-9849-4cbb-a820-b188e62c521a None admin] PATH_INFO: `/v3/projects/28eb6f2c13e0482aa669c7abeafeb5bb` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:58.384652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed4ba3-9849-4cbb-a820-b188e62c521a None admin] RBAC: Authorizing `identity:get_project(project_id=28eb6f2c13e0482aa669c7abeafeb5bb)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:58.386704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed4ba3-9849-4cbb-a820-b188e62c521a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:58.389239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 49/96] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:57:58 2022] GET /identity/v3/projects/28eb6f2c13e0482aa669c7abeafeb5bb => generated 312 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:58.394831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848ab9b-4396-4cd5-b4bc-df5e1fad4bd0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:58.514980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848ab9b-4396-4cd5-b4bc-df5e1fad4bd0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:58.551393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc848fa-bf7f-4a1e-a345-80f92864552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:58.552042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc848fa-bf7f-4a1e-a345-80f92864552c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:58.552326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc848fa-bf7f-4a1e-a345-80f92864552c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:58.552602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc848fa-bf7f-4a1e-a345-80f92864552c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:58.553338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc848fa-bf7f-4a1e-a345-80f92864552c None admin] RBAC: Adding query filter params (role.id=df79e12324de40afbb353b95363811cc, scope.project.id=28eb6f2c13e0482aa669c7abeafeb5bb, user.id=a1274ffcf97a4e5db55bf956186d0e54) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:57:58.554281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc848fa-bf7f-4a1e-a345-80f92864552c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:58.555756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc848fa-bf7f-4a1e-a345-80f92864552c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:58.562107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 48/97] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:57:58 2022] GET /identity/v3/role_assignments?user.id=a1274ffcf97a4e5db55bf956186d0e54&scope.project.id=28eb6f2c13e0482aa669c7abeafeb5bb&role.id=df79e12324de40afbb353b95363811cc => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:57:59.442418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccd9ed-828e-4788-99b0-7268f8950183 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:59.442899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccd9ed-828e-4788-99b0-7268f8950183 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:59.442899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccd9ed-828e-4788-99b0-7268f8950183 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:59.444809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 50/98] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:59.450821 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a549c37-ff07-4a6b-bb5a-e72d5d28bcfa None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:59.451770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a549c37-ff07-4a6b-bb5a-e72d5d28bcfa None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:59.452259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a549c37-ff07-4a6b-bb5a-e72d5d28bcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:59.471830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4a549c37-ff07-4a6b-bb5a-e72d5d28bcfa None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:59.473365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4a549c37-ff07-4a6b-bb5a-e72d5d28bcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:59.541122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:59.564777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:57:59.799404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba16598-f460-4e1e-8967-e45d6d84c60d None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:59.799404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba16598-f460-4e1e-8967-e45d6d84c60d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:59.799404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba16598-f460-4e1e-8967-e45d6d84c60d None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:59.799404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 51/100] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:57:59.805786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baf0b8-5f46-47c2-9a29-5d24969e8673 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:59.806362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baf0b8-5f46-47c2-9a29-5d24969e8673 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:59.806833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baf0b8-5f46-47c2-9a29-5d24969e8673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:59.836623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-19baf0b8-5f46-47c2-9a29-5d24969e8673 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:59.838128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-19baf0b8-5f46-47c2-9a29-5d24969e8673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:59.911997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 50/101] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:00.017006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba16598-f460-4e1e-8967-e45d6d84c60d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.160391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba16598-f460-4e1e-8967-e45d6d84c60d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.200111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88d06-cbe9-4829-88ab-089be0af8e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.200748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88d06-cbe9-4829-88ab-089be0af8e67 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.201035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88d06-cbe9-4829-88ab-089be0af8e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.201314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88d06-cbe9-4829-88ab-089be0af8e67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.212676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae88d06-cbe9-4829-88ab-089be0af8e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4ae88d06-cbe9-4829-88ab-089be0af8e67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:00.218089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:00.218911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:00.219692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 52/102] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:00.229778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baf0b8-5f46-47c2-9a29-5d24969e8673 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.274789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88d06-cbe9-4829-88ab-089be0af8e67 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.360008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:00.414561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baf0b8-5f46-47c2-9a29-5d24969e8673 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.433973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:00.473405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc4dc-01a1-4bdf-a3e4-8137576c6da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.475257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc4dc-01a1-4bdf-a3e4-8137576c6da4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.476367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc4dc-01a1-4bdf-a3e4-8137576c6da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.476831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc4dc-01a1-4bdf-a3e4-8137576c6da4 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.477729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdc4dc-01a1-4bdf-a3e4-8137576c6da4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:00.478226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdc4dc-01a1-4bdf-a3e4-8137576c6da4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.479940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdc4dc-01a1-4bdf-a3e4-8137576c6da4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.481058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88d06-cbe9-4829-88ab-089be0af8e67 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.495755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 51/103] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:00.503352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc4dc-01a1-4bdf-a3e4-8137576c6da4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.596374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dfcee-7337-41a1-9882-7db5ebcb0e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.597425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dfcee-7337-41a1-9882-7db5ebcb0e19 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.597977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dfcee-7337-41a1-9882-7db5ebcb0e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.598467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dfcee-7337-41a1-9882-7db5ebcb0e19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.599970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dfcee-7337-41a1-9882-7db5ebcb0e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.602286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dfcee-7337-41a1-9882-7db5ebcb0e19 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.604520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 53/104] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:00.612316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc4dc-01a1-4bdf-a3e4-8137576c6da4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.612649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dfcee-7337-41a1-9882-7db5ebcb0e19 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.648752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c078e3a-a25c-43a2-aeb4-555103d20eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.649740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c078e3a-a25c-43a2-aeb4-555103d20eec None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.650221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c078e3a-a25c-43a2-aeb4-555103d20eec None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.650690 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c078e3a-a25c-43a2-aeb4-555103d20eec None admin] PATH_INFO: `/v3/users/7159cb099ea24d4380497ccb80ac0f69` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.667590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c078e3a-a25c-43a2-aeb4-555103d20eec None admin] RBAC: Authorizing `identity:get_user(user_id=7159cb099ea24d4380497ccb80ac0f69)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.669401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c078e3a-a25c-43a2-aeb4-555103d20eec None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.671756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 52/105] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:00 2022] GET /identity/v3/users/7159cb099ea24d4380497ccb80ac0f69 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:00.681261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c078e3a-a25c-43a2-aeb4-555103d20eec None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.719652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:00.786796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c078e3a-a25c-43a2-aeb4-555103d20eec None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.835867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dfcee-7337-41a1-9882-7db5ebcb0e19 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.848454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:00.860376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b239499-c240-49d5-adc7-e59da27a9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.861023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b239499-c240-49d5-adc7-e59da27a9faf None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.861303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b239499-c240-49d5-adc7-e59da27a9faf None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.861585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b239499-c240-49d5-adc7-e59da27a9faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.874609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca814e3-9827-4366-8024-f279b01d0f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.875504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca814e3-9827-4366-8024-f279b01d0f81 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.875977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca814e3-9827-4366-8024-f279b01d0f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.876427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca814e3-9827-4366-8024-f279b01d0f81 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.877274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca814e3-9827-4366-8024-f279b01d0f81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.878904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca814e3-9827-4366-8024-f279b01d0f81 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.958096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b239499-c240-49d5-adc7-e59da27a9faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.960576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b239499-c240-49d5-adc7-e59da27a9faf None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.981362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 54/106] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 11:58:00 2022] POST /identity/v3/projects => generated 302 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:00.983031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f847-01f2-4a3b-931f-9543455c8fe7 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.986818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f847-01f2-4a3b-931f-9543455c8fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.986818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f847-01f2-4a3b-931f-9543455c8fe7 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.987584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 55/107] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:00.993681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d3b89-986f-4898-bf7e-1f5716db091d None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.994265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d3b89-986f-4898-bf7e-1f5716db091d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.994773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d3b89-986f-4898-bf7e-1f5716db091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:01.015840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:01.054241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d60d3b89-986f-4898-bf7e-1f5716db091d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:01.061868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d60d3b89-986f-4898-bf7e-1f5716db091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:01.200462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 53/108] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:01.207076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b239499-c240-49d5-adc7-e59da27a9faf None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:01.249213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 56/109] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:01.266236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200d241-d422-47f3-b2a9-043b981daafc None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:01.266520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200d241-d422-47f3-b2a9-043b981daafc None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:01.266799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200d241-d422-47f3-b2a9-043b981daafc None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:01.268325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 57/110] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:01.275520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ace42-2463-4b0e-abbe-29e0db0da6dd None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:01.275829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ace42-2463-4b0e-abbe-29e0db0da6dd None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:01.276109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ace42-2463-4b0e-abbe-29e0db0da6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:01.307400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-5d1ace42-2463-4b0e-abbe-29e0db0da6dd None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:01.308644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5d1ace42-2463-4b0e-abbe-29e0db0da6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:01.415950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b239499-c240-49d5-adc7-e59da27a9faf None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:01.445812 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:01.455805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 58/111] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 09 11:58:01.460346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc32f57-4b0f-4bef-93e6-c45ca0fc48ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:01.461269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc32f57-4b0f-4bef-93e6-c45ca0fc48ba None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:01.461751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc32f57-4b0f-4bef-93e6-c45ca0fc48ba None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:01.462245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc32f57-4b0f-4bef-93e6-c45ca0fc48ba None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:01.464637 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc32f57-4b0f-4bef-93e6-c45ca0fc48ba None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:01.466421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc32f57-4b0f-4bef-93e6-c45ca0fc48ba None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:01.473248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 54/112] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:01 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:01.474921 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ace42-2463-4b0e-abbe-29e0db0da6dd None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:01.514548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:01.578739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc32f57-4b0f-4bef-93e6-c45ca0fc48ba None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:01.606190 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ace42-2463-4b0e-abbe-29e0db0da6dd None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:01.682193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e040fa8-6f9d-429b-800a-1002a55b9412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:01.682812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e040fa8-6f9d-429b-800a-1002a55b9412 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:01.683093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e040fa8-6f9d-429b-800a-1002a55b9412 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:01.683365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e040fa8-6f9d-429b-800a-1002a55b9412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:01.684149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e040fa8-6f9d-429b-800a-1002a55b9412 None admin] RBAC: Adding query filter params (role.id=accf76b1c5d94b02b8e0650939fab7f9, scope.project.id=9078564600ac4355acf60302d36d426d, user.id=7159cb099ea24d4380497ccb80ac0f69) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:01.684441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e040fa8-6f9d-429b-800a-1002a55b9412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:01.685890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e040fa8-6f9d-429b-800a-1002a55b9412 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:01.698249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 59/113] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:01 2022] GET /identity/v3/role_assignments?user.id=7159cb099ea24d4380497ccb80ac0f69&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=accf76b1c5d94b02b8e0650939fab7f9 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:01.779387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc32f57-4b0f-4bef-93e6-c45ca0fc48ba None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:01.825151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad1e32-9221-43a7-9716-961f1f616af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:01.826232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad1e32-9221-43a7-9716-961f1f616af3 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:01.826713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad1e32-9221-43a7-9716-961f1f616af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:01.827327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad1e32-9221-43a7-9716-961f1f616af3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:01.834689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf602895-475f-422e-9c52-c5ce979d0b94 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:01.835516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf602895-475f-422e-9c52-c5ce979d0b94 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:01.835826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf602895-475f-422e-9c52-c5ce979d0b94 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:01.837464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 60/114] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:01.843064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03339f5d-e0fd-49be-a8e1-88a60ca86e7e None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:01.843358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03339f5d-e0fd-49be-a8e1-88a60ca86e7e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:01.843652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03339f5d-e0fd-49be-a8e1-88a60ca86e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:01.845523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad1e32-9221-43a7-9716-961f1f616af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-3fad1e32-9221-43a7-9716-961f1f616af3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:01.853683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:01.854572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:01.855416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:01.857793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 55/115] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:58:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:01.863669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad1e32-9221-43a7-9716-961f1f616af3 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:01.880810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-03339f5d-e0fd-49be-a8e1-88a60ca86e7e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:01.882082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-03339f5d-e0fd-49be-a8e1-88a60ca86e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:01.978512 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:01.999170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 61/116] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:02.008363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03339f5d-e0fd-49be-a8e1-88a60ca86e7e None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:02.039582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad1e32-9221-43a7-9716-961f1f616af3 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:02.040016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:02.091871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a396100-e3ff-419b-8b85-3588724a12f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:02.092501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396100-e3ff-419b-8b85-3588724a12f8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.092786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396100-e3ff-419b-8b85-3588724a12f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.093064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396100-e3ff-419b-8b85-3588724a12f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.093782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a396100-e3ff-419b-8b85-3588724a12f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:02.094387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a396100-e3ff-419b-8b85-3588724a12f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:02.095813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a396100-e3ff-419b-8b85-3588724a12f8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:02.107253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 56/117] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:02.113456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a396100-e3ff-419b-8b85-3588724a12f8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:02.184230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03339f5d-e0fd-49be-a8e1-88a60ca86e7e None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:02.246770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6ae2a-dc83-4a98-892c-cda4a1de61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:02.247470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ae2a-dc83-4a98-892c-cda4a1de61a3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.248048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ae2a-dc83-4a98-892c-cda4a1de61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.248325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ae2a-dc83-4a98-892c-cda4a1de61a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.268650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6ae2a-dc83-4a98-892c-cda4a1de61a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-3fe6ae2a-dc83-4a98-892c-cda4a1de61a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:02.276402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:02.277228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:02.278013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 62/118] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:02.279355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9c61c-25d2-4c5b-b59f-f268ad71a38f None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.279355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9c61c-25d2-4c5b-b59f-f268ad71a38f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.279355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9c61c-25d2-4c5b-b59f-f268ad71a38f None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.289388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 63/119] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:02.292054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9c61c-25d2-4c5b-b59f-f268ad71a38f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:02.307794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a396100-e3ff-419b-8b85-3588724a12f8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:02.338218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:02.372542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbeabf-3a43-44c0-afbc-7a8eac4b6170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:02.373448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbeabf-3a43-44c0-afbc-7a8eac4b6170 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.373990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbeabf-3a43-44c0-afbc-7a8eac4b6170 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.374271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbeabf-3a43-44c0-afbc-7a8eac4b6170 None admin] PATH_INFO: `/v3/users/e0d78cac7890401997b98a7dab7b659c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.376144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbeabf-3a43-44c0-afbc-7a8eac4b6170 None admin] RBAC: Authorizing `identity:get_user(user_id=e0d78cac7890401997b98a7dab7b659c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:02.378227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbeabf-3a43-44c0-afbc-7a8eac4b6170 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:02.380142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 57/120] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:02 2022] GET /identity/v3/users/e0d78cac7890401997b98a7dab7b659c => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:02.381551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1210dd-8ee3-4545-829f-556e1e0ef129 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.382387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1210dd-8ee3-4545-829f-556e1e0ef129 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.383261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1210dd-8ee3-4545-829f-556e1e0ef129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.395303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:02.407042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-1e1210dd-8ee3-4545-829f-556e1e0ef129 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:02.408747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1e1210dd-8ee3-4545-829f-556e1e0ef129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:02.423242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9c61c-25d2-4c5b-b59f-f268ad71a38f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:02.470049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe87d7e-7a53-49b0-b3a5-6e884b1e7c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:02.470882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe87d7e-7a53-49b0-b3a5-6e884b1e7c1f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.471338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe87d7e-7a53-49b0-b3a5-6e884b1e7c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.471700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe87d7e-7a53-49b0-b3a5-6e884b1e7c1f None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.472383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe87d7e-7a53-49b0-b3a5-6e884b1e7c1f None admin] RBAC: Adding query filter params (name=member) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:02.472742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe87d7e-7a53-49b0-b3a5-6e884b1e7c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:02.474378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe87d7e-7a53-49b0-b3a5-6e884b1e7c1f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:02.484728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 64/121] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:02.485764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe87d7e-7a53-49b0-b3a5-6e884b1e7c1f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:02.492967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 58/122] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:02.493781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1210dd-8ee3-4545-829f-556e1e0ef129 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:02.604275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1210dd-8ee3-4545-829f-556e1e0ef129 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:02.628376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:02.641423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c16d00-14f9-434f-85eb-641809daf511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:02.642061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16d00-14f9-434f-85eb-641809daf511 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.642396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16d00-14f9-434f-85eb-641809daf511 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.643827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16d00-14f9-434f-85eb-641809daf511 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.648730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c16d00-14f9-434f-85eb-641809daf511 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:02.650189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c16d00-14f9-434f-85eb-641809daf511 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:02.651942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 59/123] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:02 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:02.652704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c16d00-14f9-434f-85eb-641809daf511 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:02.692911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe87d7e-7a53-49b0-b3a5-6e884b1e7c1f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:02.737239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3a2ff-2e87-402c-ba5b-8e7d7f4b8a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:02.737873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3a2ff-2e87-402c-ba5b-8e7d7f4b8a13 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.738155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3a2ff-2e87-402c-ba5b-8e7d7f4b8a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.738432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3a2ff-2e87-402c-ba5b-8e7d7f4b8a13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.746003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:02.751738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3a2ff-2e87-402c-ba5b-8e7d7f4b8a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-b8f3a2ff-2e87-402c-ba5b-8e7d7f4b8a13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:02.756874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:02.758692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 65/124] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:02.759481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3a2ff-2e87-402c-ba5b-8e7d7f4b8a13 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:02.875992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c16d00-14f9-434f-85eb-641809daf511 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:02.912888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3a2ff-2e87-402c-ba5b-8e7d7f4b8a13 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:02.918829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2567ad6-1ef9-4cca-8b5c-e31fef8ed341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:02.919474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2567ad6-1ef9-4cca-8b5c-e31fef8ed341 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.919792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2567ad6-1ef9-4cca-8b5c-e31fef8ed341 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.920075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2567ad6-1ef9-4cca-8b5c-e31fef8ed341 None admin] PATH_INFO: `/v3/users/a1274ffcf97a4e5db55bf956186d0e54` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.921230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2567ad6-1ef9-4cca-8b5c-e31fef8ed341 None admin] RBAC: Authorizing `identity:get_user(user_id=a1274ffcf97a4e5db55bf956186d0e54)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:02.922840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2567ad6-1ef9-4cca-8b5c-e31fef8ed341 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:02.924931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 60/125] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:02 2022] GET /identity/v3/users/a1274ffcf97a4e5db55bf956186d0e54 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:02.926334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2567ad6-1ef9-4cca-8b5c-e31fef8ed341 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:02.969941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ced6f7-0b51-4c42-bba9-e5c9f9ce21c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:02.970920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ced6f7-0b51-4c42-bba9-e5c9f9ce21c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:02.972156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ced6f7-0b51-4c42-bba9-e5c9f9ce21c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:02.972454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ced6f7-0b51-4c42-bba9-e5c9f9ce21c5 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d/users/e0d78cac7890401997b98a7dab7b659c/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:02.974465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ced6f7-0b51-4c42-bba9-e5c9f9ce21c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9078564600ac4355acf60302d36d426d, user_id=e0d78cac7890401997b98a7dab7b659c, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:02.976002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ced6f7-0b51-4c42-bba9-e5c9f9ce21c5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:02.991206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:03.041170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2567ad6-1ef9-4cca-8b5c-e31fef8ed341 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:03.046262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 66/126] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:58:02 2022] PUT /identity/v3/projects/9078564600ac4355acf60302d36d426d/users/e0d78cac7890401997b98a7dab7b659c/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:03.047475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ced6f7-0b51-4c42-bba9-e5c9f9ce21c5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:03.136675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:03.176960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d701a79-427a-4e67-befa-11e0de6a388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:03.177607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d701a79-427a-4e67-befa-11e0de6a388b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:03.177895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d701a79-427a-4e67-befa-11e0de6a388b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:03.178175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d701a79-427a-4e67-befa-11e0de6a388b None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:03.178902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d701a79-427a-4e67-befa-11e0de6a388b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:03.179210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d701a79-427a-4e67-befa-11e0de6a388b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:03.180625 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d701a79-427a-4e67-befa-11e0de6a388b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:03.186205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ced6f7-0b51-4c42-bba9-e5c9f9ce21c5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:03.213646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 61/127] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:03.214552 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d701a79-427a-4e67-befa-11e0de6a388b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:03.231491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030361f-cc11-483d-8b34-39ddbbed3d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:03.232180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030361f-cc11-483d-8b34-39ddbbed3d88 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:03.232474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030361f-cc11-483d-8b34-39ddbbed3d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:03.232758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030361f-cc11-483d-8b34-39ddbbed3d88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:03.250186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030361f-cc11-483d-8b34-39ddbbed3d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-d030361f-cc11-483d-8b34-39ddbbed3d88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:03.255956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:03.257403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:03.258173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:03.260603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 67/128] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:03.261627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030361f-cc11-483d-8b34-39ddbbed3d88 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:03.350025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d701a79-427a-4e67-befa-11e0de6a388b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:03.367049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:03.377825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030361f-cc11-483d-8b34-39ddbbed3d88 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:03.392001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22f564-b7e5-45e8-9bc0-467398eeac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:03.392717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22f564-b7e5-45e8-9bc0-467398eeac54 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:03.392822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22f564-b7e5-45e8-9bc0-467398eeac54 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:03.393061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22f564-b7e5-45e8-9bc0-467398eeac54 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:03.394215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22f564-b7e5-45e8-9bc0-467398eeac54 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:03.395696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22f564-b7e5-45e8-9bc0-467398eeac54 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:03.397413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 62/129] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:03 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:03.398287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22f564-b7e5-45e8-9bc0-467398eeac54 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:03.399759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:03.418008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a614-62f1-4828-aa01-65176276e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:03.419021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a614-62f1-4828-aa01-65176276e3ee None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:03.420453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a614-62f1-4828-aa01-65176276e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:03.420989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a614-62f1-4828-aa01-65176276e3ee None admin] PATH_INFO: `/v3/users/a1274ffcf97a4e5db55bf956186d0e54` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:03.422393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0a614-62f1-4828-aa01-65176276e3ee None admin] RBAC: Authorizing `identity:get_user(user_id=a1274ffcf97a4e5db55bf956186d0e54)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:03.424125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0a614-62f1-4828-aa01-65176276e3ee None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:03.432166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 68/130] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:03 2022] GET /identity/v3/users/a1274ffcf97a4e5db55bf956186d0e54 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:03.433367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a614-62f1-4828-aa01-65176276e3ee None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:03.516041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22f564-b7e5-45e8-9bc0-467398eeac54 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:03.554479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e306e4-04bc-44e6-a256-aa404a090605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:03.555104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e306e4-04bc-44e6-a256-aa404a090605 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:03.555389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e306e4-04bc-44e6-a256-aa404a090605 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:03.555700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e306e4-04bc-44e6-a256-aa404a090605 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:03.556449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e306e4-04bc-44e6-a256-aa404a090605 None admin] RBAC: Adding query filter params (name=member) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:03.556770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e306e4-04bc-44e6-a256-aa404a090605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:03.558153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e306e4-04bc-44e6-a256-aa404a090605 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:03.568365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 63/131] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:03.569936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e306e4-04bc-44e6-a256-aa404a090605 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:03.623270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:03.656442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a614-62f1-4828-aa01-65176276e3ee None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:03.686021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e306e4-04bc-44e6-a256-aa404a090605 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:03.724048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7209b-ef3b-414e-8b68-d5ff6f19501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:03.724961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7209b-ef3b-414e-8b68-d5ff6f19501f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:03.725908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7209b-ef3b-414e-8b68-d5ff6f19501f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:03.726330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7209b-ef3b-414e-8b68-d5ff6f19501f None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:03.727748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7209b-ef3b-414e-8b68-d5ff6f19501f None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:03.729355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7209b-ef3b-414e-8b68-d5ff6f19501f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:03.731173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 64/132] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:03 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:03.732144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7209b-ef3b-414e-8b68-d5ff6f19501f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:03.737810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654050-1dfe-4ad2-86d4-96bcdc30b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:03.738629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654050-1dfe-4ad2-86d4-96bcdc30b8ce None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:03.739032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654050-1dfe-4ad2-86d4-96bcdc30b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:03.739407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654050-1dfe-4ad2-86d4-96bcdc30b8ce None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d/users/a1274ffcf97a4e5db55bf956186d0e54/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:03.747866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03654050-1dfe-4ad2-86d4-96bcdc30b8ce None admin] RBAC: Authorizing `identity:create_grant(project_id=9078564600ac4355acf60302d36d426d, user_id=a1274ffcf97a4e5db55bf956186d0e54, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:03.749477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03654050-1dfe-4ad2-86d4-96bcdc30b8ce None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:03.841991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7209b-ef3b-414e-8b68-d5ff6f19501f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:03.854762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 69/133] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:58:03 2022] PUT /identity/v3/projects/9078564600ac4355acf60302d36d426d/users/a1274ffcf97a4e5db55bf956186d0e54/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:03.855694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654050-1dfe-4ad2-86d4-96bcdc30b8ce None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:03.856710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:03.883896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb4f12-d1a3-4e35-8a9c-896544e34eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:03.886656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb4f12-d1a3-4e35-8a9c-896544e34eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:03.887139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb4f12-d1a3-4e35-8a9c-896544e34eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:03.887566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb4f12-d1a3-4e35-8a9c-896544e34eb6 None admin] PATH_INFO: `/v3/users/a1274ffcf97a4e5db55bf956186d0e54` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:03.890112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb4f12-d1a3-4e35-8a9c-896544e34eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=a1274ffcf97a4e5db55bf956186d0e54)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:03.892945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb4f12-d1a3-4e35-8a9c-896544e34eb6 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:03.896309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 65/134] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:03 2022] GET /identity/v3/users/a1274ffcf97a4e5db55bf956186d0e54 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:03.904041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb4f12-d1a3-4e35-8a9c-896544e34eb6 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:03.955672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:04.060687 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb4f12-d1a3-4e35-8a9c-896544e34eb6 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:04.070954 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654050-1dfe-4ad2-86d4-96bcdc30b8ce None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:04.124397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebfbf4-34bc-42aa-9322-a42851f84868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:04.125068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfbf4-34bc-42aa-9322-a42851f84868 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:04.125355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfbf4-34bc-42aa-9322-a42851f84868 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:04.125634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfbf4-34bc-42aa-9322-a42851f84868 None admin] PATH_INFO: `/v3/projects/28eb6f2c13e0482aa669c7abeafeb5bb` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:04.126853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebfbf4-34bc-42aa-9322-a42851f84868 None admin] RBAC: Authorizing `identity:get_project(project_id=28eb6f2c13e0482aa669c7abeafeb5bb)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:04.128340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebfbf4-34bc-42aa-9322-a42851f84868 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:04.130325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 66/135] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:03 2022] GET /identity/v3/projects/28eb6f2c13e0482aa669c7abeafeb5bb => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:04.131375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832517-a1bf-4037-b790-c3af9a7dbf1b None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:04.131744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832517-a1bf-4037-b790-c3af9a7dbf1b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:04.132036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832517-a1bf-4037-b790-c3af9a7dbf1b None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:04.133307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 67/136] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:04.134457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625bf7d-4c59-4dde-876a-d282ee4386cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:04.135367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625bf7d-4c59-4dde-876a-d282ee4386cb None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:04.135843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625bf7d-4c59-4dde-876a-d282ee4386cb None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:04.136312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625bf7d-4c59-4dde-876a-d282ee4386cb None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d/users/a1274ffcf97a4e5db55bf956186d0e54/roles/1387b2da4fc147fe99310c8bea8504be` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:04.139333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef334f-74ee-4d1c-a522-93733daae64e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:04.139648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef334f-74ee-4d1c-a522-93733daae64e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:04.139933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef334f-74ee-4d1c-a522-93733daae64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:04.142860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625bf7d-4c59-4dde-876a-d282ee4386cb None admin] RBAC: Authorizing `identity:create_grant(project_id=9078564600ac4355acf60302d36d426d, user_id=a1274ffcf97a4e5db55bf956186d0e54, role_id=1387b2da4fc147fe99310c8bea8504be)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:04.144589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625bf7d-4c59-4dde-876a-d282ee4386cb None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:04.161714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9eef334f-74ee-4d1c-a522-93733daae64e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:04.165101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9eef334f-74ee-4d1c-a522-93733daae64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:04.208096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:04.212015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 70/137] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:58:03 2022] PUT /identity/v3/projects/9078564600ac4355acf60302d36d426d/users/a1274ffcf97a4e5db55bf956186d0e54/roles/1387b2da4fc147fe99310c8bea8504be => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:04.213152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625bf7d-4c59-4dde-876a-d282ee4386cb None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:04.252199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 68/138] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:04.395407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625bf7d-4c59-4dde-876a-d282ee4386cb None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:04.401745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d5ae-1850-443c-a8c6-997a2918bf29 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:04.402034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d5ae-1850-443c-a8c6-997a2918bf29 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:04.402311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d5ae-1850-443c-a8c6-997a2918bf29 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:04.403807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 69/139] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:04.407748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:04.409436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d830f14-c386-4f0d-9c79-5682152e873b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:04.409715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d830f14-c386-4f0d-9c79-5682152e873b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:04.409989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d830f14-c386-4f0d-9c79-5682152e873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:04.430469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3d830f14-c386-4f0d-9c79-5682152e873b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:04.430469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3d830f14-c386-4f0d-9c79-5682152e873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:04.451870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90654-ddfd-481b-9fc3-808c47ef8eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:04.452659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90654-ddfd-481b-9fc3-808c47ef8eb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:04.452950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90654-ddfd-481b-9fc3-808c47ef8eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:04.454974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90654-ddfd-481b-9fc3-808c47ef8eb6 None admin] PATH_INFO: `/v3/projects/28eb6f2c13e0482aa669c7abeafeb5bb/users/a1274ffcf97a4e5db55bf956186d0e54/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:04.455474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d90654-ddfd-481b-9fc3-808c47ef8eb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=28eb6f2c13e0482aa669c7abeafeb5bb, user_id=a1274ffcf97a4e5db55bf956186d0e54, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:04.456996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d90654-ddfd-481b-9fc3-808c47ef8eb6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:04.521398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 70/140] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:04.542381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 71/141] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:58:04 2022] PUT /identity/v3/projects/28eb6f2c13e0482aa669c7abeafeb5bb/users/a1274ffcf97a4e5db55bf956186d0e54/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:04.688014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d830f14-c386-4f0d-9c79-5682152e873b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:04.808646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d830f14-c386-4f0d-9c79-5682152e873b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:04.820129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:04.846404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3b6c2-4f55-4652-8f59-af70a03c25ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:04.847113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3b6c2-4f55-4652-8f59-af70a03c25ad None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:04.847402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3b6c2-4f55-4652-8f59-af70a03c25ad None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:04.847711 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3b6c2-4f55-4652-8f59-af70a03c25ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:04.849203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3b6c2-4f55-4652-8f59-af70a03c25ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:04.851616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3b6c2-4f55-4652-8f59-af70a03c25ad None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:04.853431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 71/142] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:04.859458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90654-ddfd-481b-9fc3-808c47ef8eb6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:05.000432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90654-ddfd-481b-9fc3-808c47ef8eb6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:05.043108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526ee96-95c4-464b-b0e2-68b740bea586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:05.044153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526ee96-95c4-464b-b0e2-68b740bea586 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:05.044638 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526ee96-95c4-464b-b0e2-68b740bea586 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:05.045210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526ee96-95c4-464b-b0e2-68b740bea586 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:05.046086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526ee96-95c4-464b-b0e2-68b740bea586 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:05.047793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526ee96-95c4-464b-b0e2-68b740bea586 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:05.054620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3b6c2-4f55-4652-8f59-af70a03c25ad None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:05.142120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 72/143] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:58:04 2022] POST /identity/v3/users => generated 283 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:05.192021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3b6c2-4f55-4652-8f59-af70a03c25ad None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:05.243292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70dc3-bf49-473a-91b1-fcf260b9d6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:05.244062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70dc3-bf49-473a-91b1-fcf260b9d6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:05.244349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70dc3-bf49-473a-91b1-fcf260b9d6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:05.244631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70dc3-bf49-473a-91b1-fcf260b9d6c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:05.260239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe70dc3-bf49-473a-91b1-fcf260b9d6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-bfe70dc3-bf49-473a-91b1-fcf260b9d6c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:05.265295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:05.266128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:05.266880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 72/144] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:05.273249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526ee96-95c4-464b-b0e2-68b740bea586 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:05.327728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:05.434983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526ee96-95c4-464b-b0e2-68b740bea586 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:05.484537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ab784-add1-4d65-9a12-43c18b7c5910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:05.485454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ab784-add1-4d65-9a12-43c18b7c5910 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:05.485942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ab784-add1-4d65-9a12-43c18b7c5910 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:05.486395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ab784-add1-4d65-9a12-43c18b7c5910 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:05.487260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ab784-add1-4d65-9a12-43c18b7c5910 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:05.487776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ab784-add1-4d65-9a12-43c18b7c5910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:05.489442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ab784-add1-4d65-9a12-43c18b7c5910 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:05.504622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 73/145] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:05.511507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70dc3-bf49-473a-91b1-fcf260b9d6c3 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:05.587103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:05.687912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70dc3-bf49-473a-91b1-fcf260b9d6c3 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:05.740987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867ecb8-ebb9-4c9f-9114-54ec100a56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:05.742212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867ecb8-ebb9-4c9f-9114-54ec100a56eb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:05.742480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867ecb8-ebb9-4c9f-9114-54ec100a56eb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:05.742717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867ecb8-ebb9-4c9f-9114-54ec100a56eb None admin] PATH_INFO: `/v3/users/7159cb099ea24d4380497ccb80ac0f69` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:05.748816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867ecb8-ebb9-4c9f-9114-54ec100a56eb None admin] RBAC: Authorizing `identity:get_user(user_id=7159cb099ea24d4380497ccb80ac0f69)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:05.750375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867ecb8-ebb9-4c9f-9114-54ec100a56eb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:05.752120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 73/146] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:05 2022] GET /identity/v3/users/7159cb099ea24d4380497ccb80ac0f69 => generated 289 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:05.764112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ab784-add1-4d65-9a12-43c18b7c5910 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:05.889080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:05.908104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ab784-add1-4d65-9a12-43c18b7c5910 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:05.950501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c6bd5-9b29-477e-a740-648a79c95e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:05.951516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c6bd5-9b29-477e-a740-648a79c95e58 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:05.952116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c6bd5-9b29-477e-a740-648a79c95e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:05.952617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c6bd5-9b29-477e-a740-648a79c95e58 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:05.956150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c6bd5-9b29-477e-a740-648a79c95e58 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:05.957835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c6bd5-9b29-477e-a740-648a79c95e58 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:05.959815 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 74/147] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:05 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:05.965924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867ecb8-ebb9-4c9f-9114-54ec100a56eb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:06.149063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867ecb8-ebb9-4c9f-9114-54ec100a56eb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:06.162156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:06.201165 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c70190-8452-47d1-9626-e6edb7b2a4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:06.201767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c70190-8452-47d1-9626-e6edb7b2a4bb None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:06.202051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c70190-8452-47d1-9626-e6edb7b2a4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:06.202329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c70190-8452-47d1-9626-e6edb7b2a4bb None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d/users/7159cb099ea24d4380497ccb80ac0f69/roles/accf76b1c5d94b02b8e0650939fab7f9` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:06.206199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c70190-8452-47d1-9626-e6edb7b2a4bb None admin] RBAC: Authorizing `identity:create_grant(project_id=9078564600ac4355acf60302d36d426d, user_id=7159cb099ea24d4380497ccb80ac0f69, role_id=accf76b1c5d94b02b8e0650939fab7f9)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:06.207729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c70190-8452-47d1-9626-e6edb7b2a4bb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:06.283425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 74/148] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:58:05 2022] PUT /identity/v3/projects/9078564600ac4355acf60302d36d426d/users/7159cb099ea24d4380497ccb80ac0f69/roles/accf76b1c5d94b02b8e0650939fab7f9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:06.553460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219de29a-0681-4d63-87a8-05042040ebac None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:06.553910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219de29a-0681-4d63-87a8-05042040ebac None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:06.554469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219de29a-0681-4d63-87a8-05042040ebac None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:06.556054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 75/149] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:06.562161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb713f-8142-4cfb-b6ac-724dc8057aaa None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:06.562453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb713f-8142-4cfb-b6ac-724dc8057aaa None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:06.562735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb713f-8142-4cfb-b6ac-724dc8057aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:06.591147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3deb713f-8142-4cfb-b6ac-724dc8057aaa None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:06.592546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3deb713f-8142-4cfb-b6ac-724dc8057aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:06.679333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 75/150] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:07.155248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219de29a-0681-4d63-87a8-05042040ebac None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:07.242394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41577a50-8db6-4713-827b-d25359cce1b6 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:07.243277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41577a50-8db6-4713-827b-d25359cce1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:07.243747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41577a50-8db6-4713-827b-d25359cce1b6 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:07.245464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 76/151] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:07.261114 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53416e9b-ab75-467c-b516-225994a28540 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:07.261704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53416e9b-ab75-467c-b516-225994a28540 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:07.262166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53416e9b-ab75-467c-b516-225994a28540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:07.293179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-53416e9b-ab75-467c-b516-225994a28540 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:07.294391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-53416e9b-ab75-467c-b516-225994a28540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:07.313291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219de29a-0681-4d63-87a8-05042040ebac None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:07.396495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f861ac8-a86f-4879-9ee5-d7f8d5e95a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:07.397087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f861ac8-a86f-4879-9ee5-d7f8d5e95a74 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:07.397417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f861ac8-a86f-4879-9ee5-d7f8d5e95a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:07.397702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f861ac8-a86f-4879-9ee5-d7f8d5e95a74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:07.416907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f861ac8-a86f-4879-9ee5-d7f8d5e95a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4f861ac8-a86f-4879-9ee5-d7f8d5e95a74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:07.421918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:07.422765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:07.423960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 76/152] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:58:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:07.429653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f861ac8-a86f-4879-9ee5-d7f8d5e95a74 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:07.438026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 77/153] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:07.451851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:07.580602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f861ac8-a86f-4879-9ee5-d7f8d5e95a74 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:07.631077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14209-5abc-46c0-9a36-94f8b414cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:07.631760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14209-5abc-46c0-9a36-94f8b414cd4d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:07.632043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14209-5abc-46c0-9a36-94f8b414cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:07.632315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14209-5abc-46c0-9a36-94f8b414cd4d None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:07.632989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d14209-5abc-46c0-9a36-94f8b414cd4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:07.633294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d14209-5abc-46c0-9a36-94f8b414cd4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:07.634681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d14209-5abc-46c0-9a36-94f8b414cd4d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:07.647387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 77/154] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:07.653225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53416e9b-ab75-467c-b516-225994a28540 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:07.700533 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:07.812954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53416e9b-ab75-467c-b516-225994a28540 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:07.855267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e688-9600-4c7c-b52b-116acb19e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:07.855947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e688-9600-4c7c-b52b-116acb19e221 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:07.856225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e688-9600-4c7c-b52b-116acb19e221 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:07.856498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e688-9600-4c7c-b52b-116acb19e221 None admin] PATH_INFO: `/v3/users/e0d78cac7890401997b98a7dab7b659c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:07.857653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9e688-9600-4c7c-b52b-116acb19e221 None admin] RBAC: Authorizing `identity:get_user(user_id=e0d78cac7890401997b98a7dab7b659c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:07.859079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9e688-9600-4c7c-b52b-116acb19e221 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:07.860740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 78/155] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:07 2022] GET /identity/v3/users/e0d78cac7890401997b98a7dab7b659c => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:07.866452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14209-5abc-46c0-9a36-94f8b414cd4d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:07.972595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:08.014951 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14209-5abc-46c0-9a36-94f8b414cd4d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:08.026908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e688-9600-4c7c-b52b-116acb19e221 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:08.067005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34398f74-2256-436c-ba7c-addfc3dddcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:08.067660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34398f74-2256-436c-ba7c-addfc3dddcac None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:08.067949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34398f74-2256-436c-ba7c-addfc3dddcac None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:08.068229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34398f74-2256-436c-ba7c-addfc3dddcac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:08.190287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34398f74-2256-436c-ba7c-addfc3dddcac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:08.197272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34398f74-2256-436c-ba7c-addfc3dddcac None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:08.230119 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:08.250163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e688-9600-4c7c-b52b-116acb19e221 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:08.332923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975e8c3-6bfb-4d69-8138-803c71618abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:08.333575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975e8c3-6bfb-4d69-8138-803c71618abe None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:08.333852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975e8c3-6bfb-4d69-8138-803c71618abe None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:08.334123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975e8c3-6bfb-4d69-8138-803c71618abe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:08.339365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:08.373022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975e8c3-6bfb-4d69-8138-803c71618abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-e975e8c3-6bfb-4d69-8138-803c71618abe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:08.377977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:08.378863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:08.379664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 79/156] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:08.385704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45dc4-bdb5-4481-85ed-6eb7e590edc4 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:08.386052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45dc4-bdb5-4481-85ed-6eb7e590edc4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:08.386332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45dc4-bdb5-4481-85ed-6eb7e590edc4 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:08.387761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 80/157] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:08.388378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 78/158] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:08.389274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34398f74-2256-436c-ba7c-addfc3dddcac None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:08.391035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832394a-f562-4282-8f16-a0cc9a3ca603 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:08.391359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832394a-f562-4282-8f16-a0cc9a3ca603 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:08.391652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832394a-f562-4282-8f16-a0cc9a3ca603 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:08.396192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 81/159] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:08.398212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a04a0-3836-4f2f-98d6-5a834081b388 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:08.398487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a04a0-3836-4f2f-98d6-5a834081b388 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:08.398764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a04a0-3836-4f2f-98d6-5a834081b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:08.437659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2c3a04a0-3836-4f2f-98d6-5a834081b388 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:08.438871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2c3a04a0-3836-4f2f-98d6-5a834081b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:08.577731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34398f74-2256-436c-ba7c-addfc3dddcac None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:08.605113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 82/160] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:08.605862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a04a0-3836-4f2f-98d6-5a834081b388 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:08.656384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbae68f-ae2f-4d41-a4d8-1942026babef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:08.657078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae68f-ae2f-4d41-a4d8-1942026babef None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:08.657362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae68f-ae2f-4d41-a4d8-1942026babef None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:08.657689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae68f-ae2f-4d41-a4d8-1942026babef None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:08.658375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbae68f-ae2f-4d41-a4d8-1942026babef None admin] RBAC: Adding query filter params (name=member) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:08.658690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbae68f-ae2f-4d41-a4d8-1942026babef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:08.660146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbae68f-ae2f-4d41-a4d8-1942026babef None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:08.678034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 79/161] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:08.679738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b0a86-837e-45aa-a956-7515c9c3cbba None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:08.680094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b0a86-837e-45aa-a956-7515c9c3cbba None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:08.680377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b0a86-837e-45aa-a956-7515c9c3cbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:08.716658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-248b0a86-837e-45aa-a956-7515c9c3cbba None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:08.717878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-248b0a86-837e-45aa-a956-7515c9c3cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:08.734103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:08.750714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a04a0-3836-4f2f-98d6-5a834081b388 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:08.775099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:08.805183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda837b1-4c6d-49b7-b489-ddacc9f53ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:08.805549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda837b1-4c6d-49b7-b489-ddacc9f53ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:08.805791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda837b1-4c6d-49b7-b489-ddacc9f53ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:08.806062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda837b1-4c6d-49b7-b489-ddacc9f53ff5 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:08.807196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda837b1-4c6d-49b7-b489-ddacc9f53ff5 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:08.808658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda837b1-4c6d-49b7-b489-ddacc9f53ff5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:08.810617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 83/162] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:08 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:08.811469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda837b1-4c6d-49b7-b489-ddacc9f53ff5 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:08.865334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 80/163] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:08.866706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b0a86-837e-45aa-a956-7515c9c3cbba None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:08.962058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda837b1-4c6d-49b7-b489-ddacc9f53ff5 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:09.005703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46f1dd-db81-434c-98a0-98616ee7261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:09.006348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46f1dd-db81-434c-98a0-98616ee7261c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:09.006625 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46f1dd-db81-434c-98a0-98616ee7261c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:09.006929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46f1dd-db81-434c-98a0-98616ee7261c None admin] PATH_INFO: `/v3/users/a1274ffcf97a4e5db55bf956186d0e54` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:09.012217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46f1dd-db81-434c-98a0-98616ee7261c None admin] RBAC: Authorizing `identity:get_user(user_id=a1274ffcf97a4e5db55bf956186d0e54)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:09.013667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46f1dd-db81-434c-98a0-98616ee7261c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:09.015301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 84/164] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:08 2022] GET /identity/v3/users/a1274ffcf97a4e5db55bf956186d0e54 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:09.020986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46f1dd-db81-434c-98a0-98616ee7261c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:09.021127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b0a86-837e-45aa-a956-7515c9c3cbba None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:09.062440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:09.080382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044f47-5b00-4811-8f32-8ba55a67cfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:09.081053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044f47-5b00-4811-8f32-8ba55a67cfaf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:09.081389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044f47-5b00-4811-8f32-8ba55a67cfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:09.081666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044f47-5b00-4811-8f32-8ba55a67cfaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:09.082411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb044f47-5b00-4811-8f32-8ba55a67cfaf None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=9078564600ac4355acf60302d36d426d, user.id=e0d78cac7890401997b98a7dab7b659c) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:09.082725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb044f47-5b00-4811-8f32-8ba55a67cfaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:09.084225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb044f47-5b00-4811-8f32-8ba55a67cfaf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:09.090701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 81/165] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:08 2022] GET /identity/v3/role_assignments?user.id=e0d78cac7890401997b98a7dab7b659c&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=06592016669243d99b430c46dd1c1d46 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:09.195893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46f1dd-db81-434c-98a0-98616ee7261c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:09.206922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044f47-5b00-4811-8f32-8ba55a67cfaf None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:09.239718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065d4b6-3df0-4f7e-8750-1cdca8dec31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:09.240344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065d4b6-3df0-4f7e-8750-1cdca8dec31e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:09.240621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065d4b6-3df0-4f7e-8750-1cdca8dec31e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:09.240891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065d4b6-3df0-4f7e-8750-1cdca8dec31e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:09.260904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:09.338820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065d4b6-3df0-4f7e-8750-1cdca8dec31e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:09.344522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065d4b6-3df0-4f7e-8750-1cdca8dec31e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:09.368746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:09.379637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044f47-5b00-4811-8f32-8ba55a67cfaf None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:09.451787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7932b6a-f325-49db-ba2d-0fe621890c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:09.452931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7932b6a-f325-49db-ba2d-0fe621890c17 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:09.453422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7932b6a-f325-49db-ba2d-0fe621890c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:09.453931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7932b6a-f325-49db-ba2d-0fe621890c17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:09.480728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7932b6a-f325-49db-ba2d-0fe621890c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-c7932b6a-f325-49db-ba2d-0fe621890c17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:09.486930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:09.487872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:09.488866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:09.491413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 82/166] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:09.497496 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7932b6a-f325-49db-ba2d-0fe621890c17 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:09.504425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 85/167] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:58:09.512336 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065d4b6-3df0-4f7e-8750-1cdca8dec31e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:09.675212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065d4b6-3df0-4f7e-8750-1cdca8dec31e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:09.675890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:09.692042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7932b6a-f325-49db-ba2d-0fe621890c17 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:09.714032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:09.747118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc7c6-9faf-4472-81b5-38be3b06fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:09.748046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc7c6-9faf-4472-81b5-38be3b06fce7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:09.748326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc7c6-9faf-4472-81b5-38be3b06fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:09.748599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc7c6-9faf-4472-81b5-38be3b06fce7 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:09.749891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfc7c6-9faf-4472-81b5-38be3b06fce7 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:09.751332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfc7c6-9faf-4472-81b5-38be3b06fce7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:09.752978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 86/168] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:09 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:09.753734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc7c6-9faf-4472-81b5-38be3b06fce7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:09.761519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226657-da1d-4c9e-8605-72e5e1ccba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:09.762139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226657-da1d-4c9e-8605-72e5e1ccba55 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:09.762421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226657-da1d-4c9e-8605-72e5e1ccba55 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:09.762697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226657-da1d-4c9e-8605-72e5e1ccba55 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:09.763403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226657-da1d-4c9e-8605-72e5e1ccba55 None admin] RBAC: Adding query filter params (name=member) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:09.763687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226657-da1d-4c9e-8605-72e5e1ccba55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:09.765074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226657-da1d-4c9e-8605-72e5e1ccba55 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:09.785448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 83/169] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:09.786296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226657-da1d-4c9e-8605-72e5e1ccba55 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:09.951939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc7c6-9faf-4472-81b5-38be3b06fce7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:09.992735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226657-da1d-4c9e-8605-72e5e1ccba55 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:10.019888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693cea-da8b-4bcc-bad2-03cec1f1bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:10.020531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693cea-da8b-4bcc-bad2-03cec1f1bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.020811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693cea-da8b-4bcc-bad2-03cec1f1bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.021084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693cea-da8b-4bcc-bad2-03cec1f1bdb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.043242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31693cea-da8b-4bcc-bad2-03cec1f1bdb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-31693cea-da8b-4bcc-bad2-03cec1f1bdb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:10.049603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:10.050463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:10.051247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:10.053130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 87/170] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:10.054509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693cea-da8b-4bcc-bad2-03cec1f1bdb6 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:10.058818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe312d0c-24bd-4754-bfdf-316c46addbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:10.059437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe312d0c-24bd-4754-bfdf-316c46addbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.059746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe312d0c-24bd-4754-bfdf-316c46addbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.060020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe312d0c-24bd-4754-bfdf-316c46addbe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.060818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe312d0c-24bd-4754-bfdf-316c46addbe9 None admin] RBAC: Adding query filter params (role.id=df79e12324de40afbb353b95363811cc, scope.project.id=9078564600ac4355acf60302d36d426d, user.id=a1274ffcf97a4e5db55bf956186d0e54) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:10.061129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe312d0c-24bd-4754-bfdf-316c46addbe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:10.062574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe312d0c-24bd-4754-bfdf-316c46addbe9 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:10.081948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 84/171] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:09 2022] GET /identity/v3/role_assignments?user.id=a1274ffcf97a4e5db55bf956186d0e54&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=df79e12324de40afbb353b95363811cc => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:10.083088 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe312d0c-24bd-4754-bfdf-316c46addbe9 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:10.138637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:10.182649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:10.281183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693cea-da8b-4bcc-bad2-03cec1f1bdb6 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:10.336945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c47cf-05c8-467a-8567-dfbf3689d1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:10.337997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c47cf-05c8-467a-8567-dfbf3689d1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.338546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c47cf-05c8-467a-8567-dfbf3689d1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.339033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c47cf-05c8-467a-8567-dfbf3689d1e8 None admin] PATH_INFO: `/v3/users/a1274ffcf97a4e5db55bf956186d0e54` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.341229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c47cf-05c8-467a-8567-dfbf3689d1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=a1274ffcf97a4e5db55bf956186d0e54)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:10.342990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c47cf-05c8-467a-8567-dfbf3689d1e8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:10.349408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 88/172] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:10 2022] GET /identity/v3/users/a1274ffcf97a4e5db55bf956186d0e54 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:10.355574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c47cf-05c8-467a-8567-dfbf3689d1e8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:10.369655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe312d0c-24bd-4754-bfdf-316c46addbe9 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:10.455140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270605ac-174d-4ca1-a5f8-579aa8eef004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:10.456061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270605ac-174d-4ca1-a5f8-579aa8eef004 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.456498 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270605ac-174d-4ca1-a5f8-579aa8eef004 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.456926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270605ac-174d-4ca1-a5f8-579aa8eef004 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.457743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270605ac-174d-4ca1-a5f8-579aa8eef004 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:10.458224 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270605ac-174d-4ca1-a5f8-579aa8eef004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:10.459867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270605ac-174d-4ca1-a5f8-579aa8eef004 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:10.473932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 85/173] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:10.480326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270605ac-174d-4ca1-a5f8-579aa8eef004 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:10.527418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c47cf-05c8-467a-8567-dfbf3689d1e8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:10.564104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:10.610638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672f0ca-5bbd-4c93-8f42-fd36314ba520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:10.611275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f0ca-5bbd-4c93-8f42-fd36314ba520 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.611571 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f0ca-5bbd-4c93-8f42-fd36314ba520 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.612108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:10.612226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f0ca-5bbd-4c93-8f42-fd36314ba520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.657455 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270605ac-174d-4ca1-a5f8-579aa8eef004 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:10.724776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033b174-be17-4577-872f-c5188e9563be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:10.727761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033b174-be17-4577-872f-c5188e9563be None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.728053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033b174-be17-4577-872f-c5188e9563be None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.728328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033b174-be17-4577-872f-c5188e9563be None admin] PATH_INFO: `/v3/users/a1274ffcf97a4e5db55bf956186d0e54` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.729946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033b174-be17-4577-872f-c5188e9563be None admin] RBAC: Authorizing `identity:get_user(user_id=a1274ffcf97a4e5db55bf956186d0e54)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:10.732089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033b174-be17-4577-872f-c5188e9563be None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:10.733929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 86/174] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:10 2022] GET /identity/v3/users/a1274ffcf97a4e5db55bf956186d0e54 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:10.735131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1a56-c845-428d-bc65-22bc0cc37c86 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.735466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1a56-c845-428d-bc65-22bc0cc37c86 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.735761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1a56-c845-428d-bc65-22bc0cc37c86 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.738008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 87/175] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:10.738420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672f0ca-5bbd-4c93-8f42-fd36314ba520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:10.739201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311edc-665d-457a-8809-ed9c9fb9fa4e None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.739481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311edc-665d-457a-8809-ed9c9fb9fa4e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.739787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311edc-665d-457a-8809-ed9c9fb9fa4e None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.740717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672f0ca-5bbd-4c93-8f42-fd36314ba520 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:10.740986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 88/176] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:10.742032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4de36-7840-4eab-a5ac-8a27b9ccb399 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.742417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4de36-7840-4eab-a5ac-8a27b9ccb399 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.742606 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4de36-7840-4eab-a5ac-8a27b9ccb399 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.743977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 89/177] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:10.744702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4de36-7840-4eab-a5ac-8a27b9ccb399 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:10.861600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 89/178] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:58:10.862672 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7f332-b968-4039-a63a-1b12ceb0616d None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.862958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7f332-b968-4039-a63a-1b12ceb0616d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.863228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7f332-b968-4039-a63a-1b12ceb0616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.867952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4de36-7840-4eab-a5ac-8a27b9ccb399 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:10.883699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-dce7f332-b968-4039-a63a-1b12ceb0616d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:10.885296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-dce7f332-b968-4039-a63a-1b12ceb0616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:10.895051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:10.909121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f95f2-3459-4301-b5cb-7380ae2f9897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:10.910103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f95f2-3459-4301-b5cb-7380ae2f9897 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.911809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f95f2-3459-4301-b5cb-7380ae2f9897 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.911809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f95f2-3459-4301-b5cb-7380ae2f9897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.929566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:10.965231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 90/179] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:10.966491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd817a-f649-4103-9af1-268d5f08e687 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:10.966929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd817a-f649-4103-9af1-268d5f08e687 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:10.967212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd817a-f649-4103-9af1-268d5f08e687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:10.989929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f3bd817a-f649-4103-9af1-268d5f08e687 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:10.990394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f95f2-3459-4301-b5cb-7380ae2f9897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:10.991670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f3bd817a-f649-4103-9af1-268d5f08e687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:10.993146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f95f2-3459-4301-b5cb-7380ae2f9897 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:11.067673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 91/180] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:11.067673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4ef15-6340-4ae9-b4bb-8de4d4557653 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.067673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4ef15-6340-4ae9-b4bb-8de4d4557653 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.067673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4ef15-6340-4ae9-b4bb-8de4d4557653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.085617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6fd4ef15-6340-4ae9-b4bb-8de4d4557653 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:11.086802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6fd4ef15-6340-4ae9-b4bb-8de4d4557653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:11.131297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 90/181] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:11.131297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f95f2-3459-4301-b5cb-7380ae2f9897 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:11.181614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:11.183004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 92/182] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:11.184416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b8cfc-5c39-49b8-9a66-6e0dbd69f77e None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.184805 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b8cfc-5c39-49b8-9a66-6e0dbd69f77e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.185207 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b8cfc-5c39-49b8-9a66-6e0dbd69f77e None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.186715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 93/183] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:11.187374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b8cfc-5c39-49b8-9a66-6e0dbd69f77e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:11.193046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:11.273597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f95f2-3459-4301-b5cb-7380ae2f9897 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:11.313114 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b8cfc-5c39-49b8-9a66-6e0dbd69f77e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:11.320346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e3d75-e264-413d-be1b-fd64e3949e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:11.320986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e3d75-e264-413d-be1b-fd64e3949e5f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.321266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e3d75-e264-413d-be1b-fd64e3949e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.321537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e3d75-e264-413d-be1b-fd64e3949e5f None admin] PATH_INFO: `/v3/projects/28eb6f2c13e0482aa669c7abeafeb5bb` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.322758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e3d75-e264-413d-be1b-fd64e3949e5f None admin] RBAC: Authorizing `identity:get_project(project_id=28eb6f2c13e0482aa669c7abeafeb5bb)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:11.324406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e3d75-e264-413d-be1b-fd64e3949e5f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:11.326296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 91/184] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/projects/28eb6f2c13e0482aa669c7abeafeb5bb => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:11.331142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec33ab4-38c7-427b-ba1e-d117e2598c11 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.331142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec33ab4-38c7-427b-ba1e-d117e2598c11 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.331142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec33ab4-38c7-427b-ba1e-d117e2598c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.346643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-cec33ab4-38c7-427b-ba1e-d117e2598c11 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:11.347654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cec33ab4-38c7-427b-ba1e-d117e2598c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:11.362778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26955122-672f-4894-983c-c83b6aad6122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:11.363660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26955122-672f-4894-983c-c83b6aad6122 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.363796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26955122-672f-4894-983c-c83b6aad6122 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.364080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26955122-672f-4894-983c-c83b6aad6122 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.365122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26955122-672f-4894-983c-c83b6aad6122 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:11.367118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26955122-672f-4894-983c-c83b6aad6122 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:11.369037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 94/185] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:11.373092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26955122-672f-4894-983c-c83b6aad6122 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:11.424309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 92/186] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:11.429520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec33ab4-38c7-427b-ba1e-d117e2598c11 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:11.456494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:11.481172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:11.493438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26955122-672f-4894-983c-c83b6aad6122 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:11.532048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707187e3-73f3-4c75-8cc2-6df339e5c740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:11.532675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707187e3-73f3-4c75-8cc2-6df339e5c740 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.532951 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707187e3-73f3-4c75-8cc2-6df339e5c740 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.533217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707187e3-73f3-4c75-8cc2-6df339e5c740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.543254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec33ab4-38c7-427b-ba1e-d117e2598c11 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:11.544645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707187e3-73f3-4c75-8cc2-6df339e5c740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-707187e3-73f3-4c75-8cc2-6df339e5c740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:11.549503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:11.550428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:11.551256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 95/187] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:11.551978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707187e3-73f3-4c75-8cc2-6df339e5c740 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:11.581487 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8e866-cc52-4101-9114-3c55b970a9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:11.582191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8e866-cc52-4101-9114-3c55b970a9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.582473 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8e866-cc52-4101-9114-3c55b970a9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.582736 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8e866-cc52-4101-9114-3c55b970a9d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.583486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8e866-cc52-4101-9114-3c55b970a9d4 None admin] RBAC: Adding query filter params (role.id=df79e12324de40afbb353b95363811cc, scope.project.id=28eb6f2c13e0482aa669c7abeafeb5bb, user.id=a1274ffcf97a4e5db55bf956186d0e54) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:11.583803 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8e866-cc52-4101-9114-3c55b970a9d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:11.585798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8e866-cc52-4101-9114-3c55b970a9d4 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:11.599649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 93/188] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/role_assignments?user.id=a1274ffcf97a4e5db55bf956186d0e54&scope.project.id=28eb6f2c13e0482aa669c7abeafeb5bb&role.id=df79e12324de40afbb353b95363811cc => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:11.599649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8e866-cc52-4101-9114-3c55b970a9d4 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:11.682419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707187e3-73f3-4c75-8cc2-6df339e5c740 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:11.717809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:11.722677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad00df-e7e8-4409-b2a3-c715199dc1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:11.723328 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad00df-e7e8-4409-b2a3-c715199dc1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.723646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad00df-e7e8-4409-b2a3-c715199dc1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.723919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad00df-e7e8-4409-b2a3-c715199dc1f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.730396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8e866-cc52-4101-9114-3c55b970a9d4 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:11.737150 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad00df-e7e8-4409-b2a3-c715199dc1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:11.740864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-76ad00df-e7e8-4409-b2a3-c715199dc1f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:11.743737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:11.745028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:11.746005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:11.750163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 96/189] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:11.752725 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad00df-e7e8-4409-b2a3-c715199dc1f6 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:11.775296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4ec3a-eca7-4aea-8e17-bd659e0ef362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:11.775947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4ec3a-eca7-4aea-8e17-bd659e0ef362 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.776234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4ec3a-eca7-4aea-8e17-bd659e0ef362 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.776513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4ec3a-eca7-4aea-8e17-bd659e0ef362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.777254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4ec3a-eca7-4aea-8e17-bd659e0ef362 None admin] RBAC: Adding query filter params (role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=9078564600ac4355acf60302d36d426d, user.id=a1274ffcf97a4e5db55bf956186d0e54) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:11.777569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4ec3a-eca7-4aea-8e17-bd659e0ef362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:11.779021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4ec3a-eca7-4aea-8e17-bd659e0ef362 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:11.785976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 94/190] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/role_assignments?user.id=a1274ffcf97a4e5db55bf956186d0e54&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=1387b2da4fc147fe99310c8bea8504be => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:11.786928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4ec3a-eca7-4aea-8e17-bd659e0ef362 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:11.888022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad00df-e7e8-4409-b2a3-c715199dc1f6 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:11.912525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4ec3a-eca7-4aea-8e17-bd659e0ef362 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:11.935880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997301b-1b60-456c-8746-24d772984a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:11.936453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997301b-1b60-456c-8746-24d772984a42 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.936738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997301b-1b60-456c-8746-24d772984a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.937083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997301b-1b60-456c-8746-24d772984a42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.949394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997301b-1b60-456c-8746-24d772984a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0997301b-1b60-456c-8746-24d772984a42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:11.954456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:11.955389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:11.956239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 97/191] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:11.957529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997301b-1b60-456c-8746-24d772984a42 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:11.957738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77638a-4111-420e-94f0-fcc2e57c266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:11.958301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77638a-4111-420e-94f0-fcc2e57c266b None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:11.958583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77638a-4111-420e-94f0-fcc2e57c266b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:11.958855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77638a-4111-420e-94f0-fcc2e57c266b None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:11.959538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77638a-4111-420e-94f0-fcc2e57c266b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:11.960483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77638a-4111-420e-94f0-fcc2e57c266b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:11.962442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77638a-4111-420e-94f0-fcc2e57c266b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:11.973518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 95/192] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:11.976662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77638a-4111-420e-94f0-fcc2e57c266b None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.019171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:12.026237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:12.079863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997301b-1b60-456c-8746-24d772984a42 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.094851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77638a-4111-420e-94f0-fcc2e57c266b None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.118615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fde63-e04a-45a7-8321-d358a5eba9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.119266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fde63-e04a-45a7-8321-d358a5eba9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.119543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fde63-e04a-45a7-8321-d358a5eba9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.119849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fde63-e04a-45a7-8321-d358a5eba9c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.120978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fde63-e04a-45a7-8321-d358a5eba9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.122452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fde63-e04a-45a7-8321-d358a5eba9c0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.124368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 98/193] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:12.125144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fde63-e04a-45a7-8321-d358a5eba9c0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.135331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91c985-607d-4092-82ea-097fb0d4b5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.135970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91c985-607d-4092-82ea-097fb0d4b5bd None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.136250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91c985-607d-4092-82ea-097fb0d4b5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.136523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91c985-607d-4092-82ea-097fb0d4b5bd None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.137187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91c985-607d-4092-82ea-097fb0d4b5bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:12.137488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91c985-607d-4092-82ea-097fb0d4b5bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.138862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91c985-607d-4092-82ea-097fb0d4b5bd None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.146696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 96/194] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:12.148050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91c985-607d-4092-82ea-097fb0d4b5bd None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.229448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fde63-e04a-45a7-8321-d358a5eba9c0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.242135 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:12.248243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91c985-607d-4092-82ea-097fb0d4b5bd None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.250152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:12.263988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5c5a-0a58-49b5-86b8-22c71080b635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.264591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5c5a-0a58-49b5-86b8-22c71080b635 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.264871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5c5a-0a58-49b5-86b8-22c71080b635 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.265145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5c5a-0a58-49b5-86b8-22c71080b635 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.265818 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5c5a-0a58-49b5-86b8-22c71080b635 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:12.266108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5c5a-0a58-49b5-86b8-22c71080b635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.267472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5c5a-0a58-49b5-86b8-22c71080b635 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.276537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 99/195] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:12.278443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5c5a-0a58-49b5-86b8-22c71080b635 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.282278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbe027-ace8-4bc9-a331-cdd5bc8d092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.282920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbe027-ace8-4bc9-a331-cdd5bc8d092d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.283197 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbe027-ace8-4bc9-a331-cdd5bc8d092d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.283472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbe027-ace8-4bc9-a331-cdd5bc8d092d None admin] PATH_INFO: `/v3/users/6f64c43fee3645adbd083253dd0231ad` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.297070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbe027-ace8-4bc9-a331-cdd5bc8d092d None admin] RBAC: Authorizing `identity:get_user(user_id=6f64c43fee3645adbd083253dd0231ad)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.298525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbe027-ace8-4bc9-a331-cdd5bc8d092d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.300182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 97/196] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:12 2022] GET /identity/v3/users/6f64c43fee3645adbd083253dd0231ad => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:12.300955 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbe027-ace8-4bc9-a331-cdd5bc8d092d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.378343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5c5a-0a58-49b5-86b8-22c71080b635 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.401710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbe027-ace8-4bc9-a331-cdd5bc8d092d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.410971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb107c7-f36d-41dc-adf1-273104eedfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.411593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb107c7-f36d-41dc-adf1-273104eedfad None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.411913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb107c7-f36d-41dc-adf1-273104eedfad None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.412184 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb107c7-f36d-41dc-adf1-273104eedfad None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.412862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb107c7-f36d-41dc-adf1-273104eedfad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.414877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb107c7-f36d-41dc-adf1-273104eedfad None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.434336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01083ce-b5b2-4a32-a47b-f2b37afe49d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.434971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01083ce-b5b2-4a32-a47b-f2b37afe49d6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.435247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01083ce-b5b2-4a32-a47b-f2b37afe49d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.435520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01083ce-b5b2-4a32-a47b-f2b37afe49d6 None admin] PATH_INFO: `/v3/users/6f64c43fee3645adbd083253dd0231ad` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.436781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01083ce-b5b2-4a32-a47b-f2b37afe49d6 None admin] RBAC: Authorizing `identity:get_user(user_id=6f64c43fee3645adbd083253dd0231ad)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.438099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01083ce-b5b2-4a32-a47b-f2b37afe49d6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.439671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 98/197] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:12 2022] GET /identity/v3/users/6f64c43fee3645adbd083253dd0231ad => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:12.440419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01083ce-b5b2-4a32-a47b-f2b37afe49d6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.465122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:12.512311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 100/198] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:58:12 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:12.513078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb107c7-f36d-41dc-adf1-273104eedfad None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.545985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01083ce-b5b2-4a32-a47b-f2b37afe49d6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.567225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:12.583219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92836a32-2d8a-411b-8dc9-9bf3affe95ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.583991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92836a32-2d8a-411b-8dc9-9bf3affe95ac None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.584281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92836a32-2d8a-411b-8dc9-9bf3affe95ac None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.584561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92836a32-2d8a-411b-8dc9-9bf3affe95ac None admin] PATH_INFO: `/v3/users/7159cb099ea24d4380497ccb80ac0f69` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.586342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92836a32-2d8a-411b-8dc9-9bf3affe95ac None admin] RBAC: Authorizing `identity:get_user(user_id=7159cb099ea24d4380497ccb80ac0f69)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.587885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92836a32-2d8a-411b-8dc9-9bf3affe95ac None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.589563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 99/199] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:12 2022] GET /identity/v3/users/7159cb099ea24d4380497ccb80ac0f69 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:12.590451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92836a32-2d8a-411b-8dc9-9bf3affe95ac None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.644055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb107c7-f36d-41dc-adf1-273104eedfad None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.682213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25911866-a755-43e4-835b-fcb7b27f4bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.682837 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25911866-a755-43e4-835b-fcb7b27f4bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.683112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25911866-a755-43e4-835b-fcb7b27f4bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.683387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25911866-a755-43e4-835b-fcb7b27f4bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.691467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:12.704107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92836a32-2d8a-411b-8dc9-9bf3affe95ac None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.744024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ed342-0c4b-466e-8541-b363624e281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.744737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ed342-0c4b-466e-8541-b363624e281e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.745026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ed342-0c4b-466e-8541-b363624e281e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.745300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ed342-0c4b-466e-8541-b363624e281e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.775523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25911866-a755-43e4-835b-fcb7b27f4bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.777069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25911866-a755-43e4-835b-fcb7b27f4bf2 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.825087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:12.831814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ed342-0c4b-466e-8541-b363624e281e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.833674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ed342-0c4b-466e-8541-b363624e281e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.902312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 101/200] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:12.904046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25911866-a755-43e4-835b-fcb7b27f4bf2 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.942587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:12.957849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 100/201] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:12.959102 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ed342-0c4b-466e-8541-b363624e281e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:13.052191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25911866-a755-43e4-835b-fcb7b27f4bf2 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:13.093034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ed342-0c4b-466e-8541-b363624e281e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:13.098143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b80c1-9ef6-47ec-a734-7505b675d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:13.098766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b80c1-9ef6-47ec-a734-7505b675d77e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:13.099046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b80c1-9ef6-47ec-a734-7505b675d77e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:13.099340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b80c1-9ef6-47ec-a734-7505b675d77e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:13.115195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:13.140868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6907baf-a25f-43dc-a032-45fb35619b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:13.141857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907baf-a25f-43dc-a032-45fb35619b56 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:13.142364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907baf-a25f-43dc-a032-45fb35619b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:13.142835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907baf-a25f-43dc-a032-45fb35619b56 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:13.144402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907baf-a25f-43dc-a032-45fb35619b56 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:13.146433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907baf-a25f-43dc-a032-45fb35619b56 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:13.148435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 101/202] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:12 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:13.149452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6907baf-a25f-43dc-a032-45fb35619b56 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:13.192216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b80c1-9ef6-47ec-a734-7505b675d77e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:13.193673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b80c1-9ef6-47ec-a734-7505b675d77e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:13.218543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:13.272940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6907baf-a25f-43dc-a032-45fb35619b56 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:13.312722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 102/203] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:13.317867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b80c1-9ef6-47ec-a734-7505b675d77e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:13.322782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cc082-dbb6-4589-9017-645d985343a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:13.323754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cc082-dbb6-4589-9017-645d985343a6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:13.324237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cc082-dbb6-4589-9017-645d985343a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:13.324750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cc082-dbb6-4589-9017-645d985343a6 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:13.326202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cc082-dbb6-4589-9017-645d985343a6 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:13.328192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cc082-dbb6-4589-9017-645d985343a6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:13.330175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 102/204] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:13 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:13.331133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cc082-dbb6-4589-9017-645d985343a6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:13.365377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:13.434302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b80c1-9ef6-47ec-a734-7505b675d77e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:13.460803 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cc082-dbb6-4589-9017-645d985343a6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:13.479239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffe0cd-39de-46ca-af2d-6ee2c97d99fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:13.480143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffe0cd-39de-46ca-af2d-6ee2c97d99fd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:13.480429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffe0cd-39de-46ca-af2d-6ee2c97d99fd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:13.480704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffe0cd-39de-46ca-af2d-6ee2c97d99fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:13.481891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffe0cd-39de-46ca-af2d-6ee2c97d99fd None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7, user.id=6f64c43fee3645adbd083253dd0231ad) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:13.482216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffe0cd-39de-46ca-af2d-6ee2c97d99fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:13.483726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffe0cd-39de-46ca-af2d-6ee2c97d99fd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:13.492069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:13.493427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 103/205] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:13 2022] GET /identity/v3/role_assignments?user.id=6f64c43fee3645adbd083253dd0231ad&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=06592016669243d99b430c46dd1c1d46 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:13.494452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffe0cd-39de-46ca-af2d-6ee2c97d99fd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:13.504867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d3e37-4064-4989-8968-89f5768b4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:13.505561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d3e37-4064-4989-8968-89f5768b4ebc None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:13.505901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d3e37-4064-4989-8968-89f5768b4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:13.506178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d3e37-4064-4989-8968-89f5768b4ebc None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:13.507838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d3e37-4064-4989-8968-89f5768b4ebc None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:13.508972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d3e37-4064-4989-8968-89f5768b4ebc None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:13.511078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 103/206] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:13 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:13.517456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d3e37-4064-4989-8968-89f5768b4ebc None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:13.633941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d3e37-4064-4989-8968-89f5768b4ebc None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:13.642784 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffe0cd-39de-46ca-af2d-6ee2c97d99fd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:13.645275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:13.677944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf86a5-608a-4e7b-a075-2f0167ad2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:13.679226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf86a5-608a-4e7b-a075-2f0167ad2e96 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:13.679637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf86a5-608a-4e7b-a075-2f0167ad2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:13.680032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf86a5-608a-4e7b-a075-2f0167ad2e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:13.680832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf86a5-608a-4e7b-a075-2f0167ad2e96 None admin] RBAC: Adding query filter params (role.id=accf76b1c5d94b02b8e0650939fab7f9, scope.project.id=9078564600ac4355acf60302d36d426d, user.id=7159cb099ea24d4380497ccb80ac0f69) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:13.681149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf86a5-608a-4e7b-a075-2f0167ad2e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:13.682841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf86a5-608a-4e7b-a075-2f0167ad2e96 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:13.691028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 104/207] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:13 2022] GET /identity/v3/role_assignments?user.id=7159cb099ea24d4380497ccb80ac0f69&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=accf76b1c5d94b02b8e0650939fab7f9 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:13.692904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229540e-f8a1-46b3-a31d-5cc5676a3954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:13.693741 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229540e-f8a1-46b3-a31d-5cc5676a3954 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:13.694217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229540e-f8a1-46b3-a31d-5cc5676a3954 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:13.694750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229540e-f8a1-46b3-a31d-5cc5676a3954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:13.695760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229540e-f8a1-46b3-a31d-5cc5676a3954 None admin] RBAC: Adding query filter params (role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7, user.id=6f64c43fee3645adbd083253dd0231ad) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:13.696290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229540e-f8a1-46b3-a31d-5cc5676a3954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:13.698053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229540e-f8a1-46b3-a31d-5cc5676a3954 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:13.704875 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 104/208] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:13 2022] GET /identity/v3/role_assignments?user.id=6f64c43fee3645adbd083253dd0231ad&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=1387b2da4fc147fe99310c8bea8504be => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:14.922304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c8cb3-fbba-4f7f-aab2-295f9af0a18a None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:14.923263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c8cb3-fbba-4f7f-aab2-295f9af0a18a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:14.923730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c8cb3-fbba-4f7f-aab2-295f9af0a18a None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:14.925657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 105/209] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:14.932951 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7df61b-52aa-4498-b353-fd7fe77ab52f None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:14.934006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7df61b-52aa-4498-b353-fd7fe77ab52f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:14.934542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7df61b-52aa-4498-b353-fd7fe77ab52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:14.955423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-fa7df61b-52aa-4498-b353-fd7fe77ab52f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:14.957128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fa7df61b-52aa-4498-b353-fd7fe77ab52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:15.032555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 105/210] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:15.056642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdcfd-5a47-41ed-b754-705a92070983 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.056940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdcfd-5a47-41ed-b754-705a92070983 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.057212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdcfd-5a47-41ed-b754-705a92070983 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:15.058561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 106/211] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:15.064115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3875f-34e2-4864-a8e2-ab1b95f52543 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.064405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3875f-34e2-4864-a8e2-ab1b95f52543 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.064689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3875f-34e2-4864-a8e2-ab1b95f52543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:15.083385 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d4c3875f-34e2-4864-a8e2-ab1b95f52543 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:15.084610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d4c3875f-34e2-4864-a8e2-ab1b95f52543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:15.166873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 106/212] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:15.319522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdcfd-5a47-41ed-b754-705a92070983 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:15.385024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:15.430325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdcfd-5a47-41ed-b754-705a92070983 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:15.457755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3875f-34e2-4864-a8e2-ab1b95f52543 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:15.474632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3deca-3301-4540-b754-8ceff09b32f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:15.476646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3deca-3301-4540-b754-8ceff09b32f4 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.476931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3deca-3301-4540-b754-8ceff09b32f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.477207 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3deca-3301-4540-b754-8ceff09b32f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:15.489252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3deca-3301-4540-b754-8ceff09b32f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:15.493318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-49c3deca-3301-4540-b754-8ceff09b32f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:15.495347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:15.496394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:15.497587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 107/213] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:15.502716 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3deca-3301-4540-b754-8ceff09b32f4 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:15.578240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3875f-34e2-4864-a8e2-ab1b95f52543 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:15.606450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3deca-3301-4540-b754-8ceff09b32f4 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:15.616939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f562a5-4cf4-4521-a2de-0a1f59c9c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:15.617871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f562a5-4cf4-4521-a2de-0a1f59c9c628 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.618332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f562a5-4cf4-4521-a2de-0a1f59c9c628 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.618813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f562a5-4cf4-4521-a2de-0a1f59c9c628 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:15.620284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f562a5-4cf4-4521-a2de-0a1f59c9c628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:15.621956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f562a5-4cf4-4521-a2de-0a1f59c9c628 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:15.628900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 107/214] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:15.630607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f562a5-4cf4-4521-a2de-0a1f59c9c628 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:15.632665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:15.644670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a070a-26be-41f3-acdc-bf2b70cad501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:15.645654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a070a-26be-41f3-acdc-bf2b70cad501 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.645994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a070a-26be-41f3-acdc-bf2b70cad501 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.646276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a070a-26be-41f3-acdc-bf2b70cad501 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:15.647242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a070a-26be-41f3-acdc-bf2b70cad501 None admin] RBAC: Adding query filter params (name=member) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:15.648206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a070a-26be-41f3-acdc-bf2b70cad501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:15.649785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a070a-26be-41f3-acdc-bf2b70cad501 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:15.663722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 108/215] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:15.667756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a070a-26be-41f3-acdc-bf2b70cad501 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:15.750163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:15.758526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f562a5-4cf4-4521-a2de-0a1f59c9c628 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:15.795573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e6864-5fa1-45a1-9ff7-adf7fd6d6cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:15.796220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e6864-5fa1-45a1-9ff7-adf7fd6d6cad None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.796502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e6864-5fa1-45a1-9ff7-adf7fd6d6cad None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.796775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e6864-5fa1-45a1-9ff7-adf7fd6d6cad None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:15.797441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e6864-5fa1-45a1-9ff7-adf7fd6d6cad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:15.798883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e6864-5fa1-45a1-9ff7-adf7fd6d6cad None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:15.813036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a070a-26be-41f3-acdc-bf2b70cad501 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:15.851567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43471-801e-465a-b2c3-76015cdb1aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:15.852599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43471-801e-465a-b2c3-76015cdb1aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.853067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43471-801e-465a-b2c3-76015cdb1aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.853514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43471-801e-465a-b2c3-76015cdb1aa4 None admin] PATH_INFO: `/v3/users/f8c0b2de9d57476885e75a98b2371c0e` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:15.871723 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43471-801e-465a-b2c3-76015cdb1aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c0b2de9d57476885e75a98b2371c0e)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:15.873525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43471-801e-465a-b2c3-76015cdb1aa4 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:15.880507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 109/216] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:15 2022] GET /identity/v3/users/f8c0b2de9d57476885e75a98b2371c0e => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:15.881596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43471-801e-465a-b2c3-76015cdb1aa4 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:15.907111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 108/217] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:58:15 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:15.940440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:15.980362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3d97-bcd6-412c-8ba0-72d96e2b71d8 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.980897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3d97-bcd6-412c-8ba0-72d96e2b71d8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.980897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3d97-bcd6-412c-8ba0-72d96e2b71d8 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:15.982311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 109/218] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:15.987803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f4176-4016-43db-910d-95e1b0e33a46 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.988098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f4176-4016-43db-910d-95e1b0e33a46 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.988365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f4176-4016-43db-910d-95e1b0e33a46 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:15.989882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 110/219] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:15.990835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adee51-3e70-4d96-b615-c1c953d705f8 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:15.991282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adee51-3e70-4d96-b615-c1c953d705f8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:15.991447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adee51-3e70-4d96-b615-c1c953d705f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:16.014338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e5adee51-3e70-4d96-b615-c1c953d705f8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:16.015586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e5adee51-3e70-4d96-b615-c1c953d705f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:16.023811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43471-801e-465a-b2c3-76015cdb1aa4 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:16.063969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45043eae-ee10-4785-bb7c-fbc69f0d2eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:16.065016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45043eae-ee10-4785-bb7c-fbc69f0d2eaf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:16.065541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45043eae-ee10-4785-bb7c-fbc69f0d2eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:16.065982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45043eae-ee10-4785-bb7c-fbc69f0d2eaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:16.104422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 111/220] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:16.104422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafdca0-ec9c-4ceb-8e1a-67736da39cea None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:16.104422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafdca0-ec9c-4ceb-8e1a-67736da39cea None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:16.104422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafdca0-ec9c-4ceb-8e1a-67736da39cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:16.126799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-1bafdca0-ec9c-4ceb-8e1a-67736da39cea None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:16.128071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1bafdca0-ec9c-4ceb-8e1a-67736da39cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:16.161544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45043eae-ee10-4785-bb7c-fbc69f0d2eaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:16.163105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45043eae-ee10-4785-bb7c-fbc69f0d2eaf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:16.260848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:16.289057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 112/221] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:16.331161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 110/222] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:58:16.337017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafdca0-ec9c-4ceb-8e1a-67736da39cea None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:16.349430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:16.390345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45043eae-ee10-4785-bb7c-fbc69f0d2eaf None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:16.453592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafdca0-ec9c-4ceb-8e1a-67736da39cea None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:16.517380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67be628-5692-4eb4-81f2-ef5f40b3691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:16.518408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67be628-5692-4eb4-81f2-ef5f40b3691d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:16.518898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67be628-5692-4eb4-81f2-ef5f40b3691d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:16.519372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67be628-5692-4eb4-81f2-ef5f40b3691d None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:16.520825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67be628-5692-4eb4-81f2-ef5f40b3691d None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:16.522506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67be628-5692-4eb4-81f2-ef5f40b3691d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:16.527938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 113/223] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:16 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:16.533288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67be628-5692-4eb4-81f2-ef5f40b3691d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:16.571766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45043eae-ee10-4785-bb7c-fbc69f0d2eaf None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:16.621580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475d9a0-9bab-477b-bbbe-41db10434bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:16.623441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475d9a0-9bab-477b-bbbe-41db10434bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:16.623950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475d9a0-9bab-477b-bbbe-41db10434bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:16.624646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475d9a0-9bab-477b-bbbe-41db10434bc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:16.634749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:16.649253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475d9a0-9bab-477b-bbbe-41db10434bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:16.649432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-3475d9a0-9bab-477b-bbbe-41db10434bc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:16.649513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:16.650319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:16.651123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 111/224] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:16.651818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475d9a0-9bab-477b-bbbe-41db10434bc9 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:16.673582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67be628-5692-4eb4-81f2-ef5f40b3691d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:16.720434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23facc80-5ab3-49ee-ace6-bc8a127b602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:16.721378 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23facc80-5ab3-49ee-ace6-bc8a127b602a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:16.721826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23facc80-5ab3-49ee-ace6-bc8a127b602a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:16.722426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23facc80-5ab3-49ee-ace6-bc8a127b602a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:16.723706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23facc80-5ab3-49ee-ace6-bc8a127b602a None admin] RBAC: Adding query filter params (role.id=df79e12324de40afbb353b95363811cc, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7, user.id=f8c0b2de9d57476885e75a98b2371c0e) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:16.724465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23facc80-5ab3-49ee-ace6-bc8a127b602a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:16.726677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23facc80-5ab3-49ee-ace6-bc8a127b602a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:16.734361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 114/225] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:16 2022] GET /identity/v3/role_assignments?user.id=f8c0b2de9d57476885e75a98b2371c0e&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=df79e12324de40afbb353b95363811cc => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:16.735606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23facc80-5ab3-49ee-ace6-bc8a127b602a None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:16.809365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475d9a0-9bab-477b-bbbe-41db10434bc9 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:16.884527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0b26-0d69-4763-af9b-2eacea64ce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:16.885558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0b26-0d69-4763-af9b-2eacea64ce84 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:16.886062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0b26-0d69-4763-af9b-2eacea64ce84 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:16.886503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0b26-0d69-4763-af9b-2eacea64ce84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:16.901270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23facc80-5ab3-49ee-ace6-bc8a127b602a None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:16.907203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae0b26-0d69-4763-af9b-2eacea64ce84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-2aae0b26-0d69-4763-af9b-2eacea64ce84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:16.912435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:16.913905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:16.914697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:16.921537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 112/226] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:58:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:16.932624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0b26-0d69-4763-af9b-2eacea64ce84 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:16.996413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abbc0a-a477-4f40-abfe-76f8d2f6d746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:16.997056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abbc0a-a477-4f40-abfe-76f8d2f6d746 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:16.997337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abbc0a-a477-4f40-abfe-76f8d2f6d746 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:16.997606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abbc0a-a477-4f40-abfe-76f8d2f6d746 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:16.998553 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abbc0a-a477-4f40-abfe-76f8d2f6d746 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:16.998857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abbc0a-a477-4f40-abfe-76f8d2f6d746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:17.000256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abbc0a-a477-4f40-abfe-76f8d2f6d746 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:17.002635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:17.025903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 115/227] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:17.031223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abbc0a-a477-4f40-abfe-76f8d2f6d746 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:17.040114 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:17.059222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0b26-0d69-4763-af9b-2eacea64ce84 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:17.120568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ded927-6552-4082-8470-b625179dbc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:17.122653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded927-6552-4082-8470-b625179dbc39 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:17.124737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded927-6552-4082-8470-b625179dbc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:17.125245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded927-6552-4082-8470-b625179dbc39 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:17.127275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ded927-6552-4082-8470-b625179dbc39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:17.127783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ded927-6552-4082-8470-b625179dbc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:17.130631 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ded927-6552-4082-8470-b625179dbc39 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:17.148488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 113/228] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:17.154231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ded927-6552-4082-8470-b625179dbc39 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:17.225241 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abbc0a-a477-4f40-abfe-76f8d2f6d746 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:17.263574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9d461-322b-4a81-918a-2bf506a496e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:17.264601 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d461-322b-4a81-918a-2bf506a496e0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:17.265044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d461-322b-4a81-918a-2bf506a496e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:17.265468 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d461-322b-4a81-918a-2bf506a496e0 None admin] PATH_INFO: `/v3/users/6f64c43fee3645adbd083253dd0231ad` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:17.266768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9d461-322b-4a81-918a-2bf506a496e0 None admin] RBAC: Authorizing `identity:get_user(user_id=6f64c43fee3645adbd083253dd0231ad)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:17.268380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9d461-322b-4a81-918a-2bf506a496e0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:17.270492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 116/229] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:17 2022] GET /identity/v3/users/6f64c43fee3645adbd083253dd0231ad => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:17.277014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9d461-322b-4a81-918a-2bf506a496e0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:17.368028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:17.374248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ded927-6552-4082-8470-b625179dbc39 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:17.385456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9d461-322b-4a81-918a-2bf506a496e0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:17.418178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:17.423929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f06d3-84a9-445a-bac7-2c2818180bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:17.424771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f06d3-84a9-445a-bac7-2c2818180bbf None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:17.426318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f06d3-84a9-445a-bac7-2c2818180bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:17.426318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f06d3-84a9-445a-bac7-2c2818180bbf None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:17.427038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f06d3-84a9-445a-bac7-2c2818180bbf None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:17.429270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f06d3-84a9-445a-bac7-2c2818180bbf None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:17.431945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 117/230] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:17 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:17.437988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f06d3-84a9-445a-bac7-2c2818180bbf None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:17.484948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a28725-a322-41f5-99a0-50ce63211689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:17.485610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a28725-a322-41f5-99a0-50ce63211689 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:17.485898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a28725-a322-41f5-99a0-50ce63211689 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:17.486175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a28725-a322-41f5-99a0-50ce63211689 None admin] PATH_INFO: `/v3/users/6f64c43fee3645adbd083253dd0231ad` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:17.491386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a28725-a322-41f5-99a0-50ce63211689 None admin] RBAC: Authorizing `identity:get_user(user_id=6f64c43fee3645adbd083253dd0231ad)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:17.493124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a28725-a322-41f5-99a0-50ce63211689 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:17.494865 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 114/231] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:17 2022] GET /identity/v3/users/6f64c43fee3645adbd083253dd0231ad => generated 283 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:17.504602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a28725-a322-41f5-99a0-50ce63211689 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:17.555377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f06d3-84a9-445a-bac7-2c2818180bbf None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:17.593522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23985ae-c586-4311-b3c0-aced4d9e503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:17.594471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23985ae-c586-4311-b3c0-aced4d9e503b None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:17.594921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23985ae-c586-4311-b3c0-aced4d9e503b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:17.595358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23985ae-c586-4311-b3c0-aced4d9e503b None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/users/6f64c43fee3645adbd083253dd0231ad/roles/1387b2da4fc147fe99310c8bea8504be` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:17.597802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23985ae-c586-4311-b3c0-aced4d9e503b None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e03e1ea52d44839b4e066f2427b2e7, user_id=6f64c43fee3645adbd083253dd0231ad, role_id=1387b2da4fc147fe99310c8bea8504be)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:17.599609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23985ae-c586-4311-b3c0-aced4d9e503b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:17.679993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 118/232] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:58:17 2022] PUT /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/users/6f64c43fee3645adbd083253dd0231ad/roles/1387b2da4fc147fe99310c8bea8504be => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:58:17.680478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:17.681464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a28725-a322-41f5-99a0-50ce63211689 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:17.728358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b976e-942e-432b-a48e-5a9a78a220da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:17.729323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b976e-942e-432b-a48e-5a9a78a220da None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:17.729673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b976e-942e-432b-a48e-5a9a78a220da None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:17.730020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b976e-942e-432b-a48e-5a9a78a220da None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:17.731430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b976e-942e-432b-a48e-5a9a78a220da None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:17.733091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b976e-942e-432b-a48e-5a9a78a220da None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:17.735186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 115/233] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:17 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:17.740989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23985ae-c586-4311-b3c0-aced4d9e503b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:17.886145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23985ae-c586-4311-b3c0-aced4d9e503b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:17.928302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beafd5-c9aa-45c7-b77a-965aa0648f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:17.929699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beafd5-c9aa-45c7-b77a-965aa0648f1a None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:17.930104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beafd5-c9aa-45c7-b77a-965aa0648f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:17.930671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beafd5-c9aa-45c7-b77a-965aa0648f1a None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/users/6f64c43fee3645adbd083253dd0231ad/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:17.932750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beafd5-c9aa-45c7-b77a-965aa0648f1a None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e03e1ea52d44839b4e066f2427b2e7, user_id=6f64c43fee3645adbd083253dd0231ad, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:17.934315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beafd5-c9aa-45c7-b77a-965aa0648f1a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:18.056884 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 119/234] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:58:17 2022] PUT /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/users/6f64c43fee3645adbd083253dd0231ad/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:18.534251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c24be-cd90-4435-8e1e-1ef17bb8755d None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:18.534799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c24be-cd90-4435-8e1e-1ef17bb8755d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:18.534799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c24be-cd90-4435-8e1e-1ef17bb8755d None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:18.536406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 116/235] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:18.542344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb159a1-1acc-4d20-ba95-ba3c404e19ef None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:18.542635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb159a1-1acc-4d20-ba95-ba3c404e19ef None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:18.542914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb159a1-1acc-4d20-ba95-ba3c404e19ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:18.565522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ceb159a1-1acc-4d20-ba95-ba3c404e19ef None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:18.566723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ceb159a1-1acc-4d20-ba95-ba3c404e19ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:18.630430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:18.648730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 120/236] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:18.999123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c24be-cd90-4435-8e1e-1ef17bb8755d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:19.078784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:19.126243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370ea98-9e6e-43e7-9d07-b6ea01ace043 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.126746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370ea98-9e6e-43e7-9d07-b6ea01ace043 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.126979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370ea98-9e6e-43e7-9d07-b6ea01ace043 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.128278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 121/237] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:19.133790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538a2de-aa31-4d46-b5b6-cb595a92ca1c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.134077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538a2de-aa31-4d46-b5b6-cb595a92ca1c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.134349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538a2de-aa31-4d46-b5b6-cb595a92ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.154748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f538a2de-aa31-4d46-b5b6-cb595a92ca1c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:19.155051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c24be-cd90-4435-8e1e-1ef17bb8755d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:19.155958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f538a2de-aa31-4d46-b5b6-cb595a92ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:19.223167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77804f8-700e-47de-b8b3-e81d504d4e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:19.223835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77804f8-700e-47de-b8b3-e81d504d4e56 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.224114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77804f8-700e-47de-b8b3-e81d504d4e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.224387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77804f8-700e-47de-b8b3-e81d504d4e56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.253655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77804f8-700e-47de-b8b3-e81d504d4e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-a77804f8-700e-47de-b8b3-e81d504d4e56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:19.260311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:19.261201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:19.261981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:19.264592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 117/238] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:19.269019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 122/239] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:19.270717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77804f8-700e-47de-b8b3-e81d504d4e56 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:19.333214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5999966-7c32-448d-9bed-232068dae825 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.333546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5999966-7c32-448d-9bed-232068dae825 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.333777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5999966-7c32-448d-9bed-232068dae825 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.339743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 123/240] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:19.344978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e49c2d-bcdc-4a45-ad2a-64ade46337bf None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.345261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e49c2d-bcdc-4a45-ad2a-64ade46337bf None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.345538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e49c2d-bcdc-4a45-ad2a-64ade46337bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.389312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-46e49c2d-bcdc-4a45-ad2a-64ade46337bf None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:19.390513 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-46e49c2d-bcdc-4a45-ad2a-64ade46337bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:19.423592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77804f8-700e-47de-b8b3-e81d504d4e56 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:19.458464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:19.480004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07057fcb-4839-43e0-b928-95c2f248ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:19.481980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07057fcb-4839-43e0-b928-95c2f248ef62 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.482257 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07057fcb-4839-43e0-b928-95c2f248ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.482527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07057fcb-4839-43e0-b928-95c2f248ef62 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.483191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07057fcb-4839-43e0-b928-95c2f248ef62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:19.483491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07057fcb-4839-43e0-b928-95c2f248ef62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:19.484948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07057fcb-4839-43e0-b928-95c2f248ef62 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:19.494660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 118/241] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:19.500361 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07057fcb-4839-43e0-b928-95c2f248ef62 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:19.518531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 124/242] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:19.605654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e49c2d-bcdc-4a45-ad2a-64ade46337bf None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:19.632536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07057fcb-4839-43e0-b928-95c2f248ef62 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:19.659604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:19.669557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd15b0-ced1-4087-8d9c-ad3de165703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:19.670201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd15b0-ced1-4087-8d9c-ad3de165703c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.670480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd15b0-ced1-4087-8d9c-ad3de165703c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.670752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd15b0-ced1-4087-8d9c-ad3de165703c None admin] PATH_INFO: `/v3/users/f8dea064eec34144b79b99dd97bfac8f` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.690891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd15b0-ced1-4087-8d9c-ad3de165703c None admin] RBAC: Authorizing `identity:get_user(user_id=f8dea064eec34144b79b99dd97bfac8f)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:19.693205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd15b0-ced1-4087-8d9c-ad3de165703c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:19.695926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 119/243] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:19 2022] GET /identity/v3/users/f8dea064eec34144b79b99dd97bfac8f => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:19.701541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd15b0-ced1-4087-8d9c-ad3de165703c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:19.728841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e49c2d-bcdc-4a45-ad2a-64ade46337bf None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:19.771702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1d071-0fca-4c8c-98c1-173f4a3eb587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:19.772503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1d071-0fca-4c8c-98c1-173f4a3eb587 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.773322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1d071-0fca-4c8c-98c1-173f4a3eb587 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.773604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1d071-0fca-4c8c-98c1-173f4a3eb587 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.779180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:19.798864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1d071-0fca-4c8c-98c1-173f4a3eb587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-1ff1d071-0fca-4c8c-98c1-173f4a3eb587 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:19.814694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:19.816826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:19.818759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 125/244] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:19.823996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1d071-0fca-4c8c-98c1-173f4a3eb587 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:19.887201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd15b0-ced1-4087-8d9c-ad3de165703c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:19.940519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83884dd0-453a-4b82-a3d2-87364b07e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:19.941317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83884dd0-453a-4b82-a3d2-87364b07e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.941603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83884dd0-453a-4b82-a3d2-87364b07e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.942155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83884dd0-453a-4b82-a3d2-87364b07e7d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.959193 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1d071-0fca-4c8c-98c1-173f4a3eb587 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:19.970668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:19.994516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4519d9-e35a-4713-ae8b-365908368104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:19.995218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4519d9-e35a-4713-ae8b-365908368104 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:19.995565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4519d9-e35a-4713-ae8b-365908368104 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:19.995922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4519d9-e35a-4713-ae8b-365908368104 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:19.996655 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4519d9-e35a-4713-ae8b-365908368104 None admin] RBAC: Adding query filter params (name=member) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:19.997157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4519d9-e35a-4713-ae8b-365908368104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:19.999111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4519d9-e35a-4713-ae8b-365908368104 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:20.009784 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 126/245] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:20.010852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4519d9-e35a-4713-ae8b-365908368104 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:20.034609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83884dd0-453a-4b82-a3d2-87364b07e7d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:20.036616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83884dd0-453a-4b82-a3d2-87364b07e7d6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:20.090854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:20.127158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4519d9-e35a-4713-ae8b-365908368104 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:20.165442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae47b2-f0ab-476f-b498-fd670bc8f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:20.166246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae47b2-f0ab-476f-b498-fd670bc8f108 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.166623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae47b2-f0ab-476f-b498-fd670bc8f108 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.167014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae47b2-f0ab-476f-b498-fd670bc8f108 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.168726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae47b2-f0ab-476f-b498-fd670bc8f108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:20.170099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae47b2-f0ab-476f-b498-fd670bc8f108 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:20.174288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 127/246] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:20.175465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae47b2-f0ab-476f-b498-fd670bc8f108 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:20.182363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 120/247] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:20.183511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83884dd0-453a-4b82-a3d2-87364b07e7d6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:20.228619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:20.298173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae47b2-f0ab-476f-b498-fd670bc8f108 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:20.315163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83884dd0-453a-4b82-a3d2-87364b07e7d6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:20.341576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b5d23-6b81-4699-acca-ead0f5d1f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:20.342211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5d23-6b81-4699-acca-ead0f5d1f090 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.342488 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5d23-6b81-4699-acca-ead0f5d1f090 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.342843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5d23-6b81-4699-acca-ead0f5d1f090 None admin] PATH_INFO: `/v3/users/f8c0b2de9d57476885e75a98b2371c0e` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.343971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b5d23-6b81-4699-acca-ead0f5d1f090 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c0b2de9d57476885e75a98b2371c0e)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:20.345919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b5d23-6b81-4699-acca-ead0f5d1f090 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:20.347662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 128/248] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:20 2022] GET /identity/v3/users/f8c0b2de9d57476885e75a98b2371c0e => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:20.348302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b5d23-6b81-4699-acca-ead0f5d1f090 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:20.355201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ef4ee-e558-4f99-9613-1f84637f86fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:20.356143 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ef4ee-e558-4f99-9613-1f84637f86fe None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.356629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ef4ee-e558-4f99-9613-1f84637f86fe None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.357098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ef4ee-e558-4f99-9613-1f84637f86fe None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.358019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ef4ee-e558-4f99-9613-1f84637f86fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:20.359835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ef4ee-e558-4f99-9613-1f84637f86fe None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:20.370594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:20.447958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b5d23-6b81-4699-acca-ead0f5d1f090 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:20.457627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:20.482298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d50247-9d00-4c6a-9563-2122480d62de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:20.482941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d50247-9d00-4c6a-9563-2122480d62de None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.491959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 121/249] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:58:20 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:20.492162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d50247-9d00-4c6a-9563-2122480d62de None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.492162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d50247-9d00-4c6a-9563-2122480d62de None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.496212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b49d-1d94-43e8-a643-11dd0499a8a6 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.496212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b49d-1d94-43e8-a643-11dd0499a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.496212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b49d-1d94-43e8-a643-11dd0499a8a6 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.496212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 122/250] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:20.496212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b49d-1d94-43e8-a643-11dd0499a8a6 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:20.496532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d50247-9d00-4c6a-9563-2122480d62de None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:20.496532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d50247-9d00-4c6a-9563-2122480d62de None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:20.498514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 129/251] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:20 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:20.499903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05f10-e1f8-4531-8184-c032624e14ee None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.500177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05f10-e1f8-4531-8184-c032624e14ee None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.500453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05f10-e1f8-4531-8184-c032624e14ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.521213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3ab05f10-e1f8-4531-8184-c032624e14ee None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:20.522450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3ab05f10-e1f8-4531-8184-c032624e14ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:20.615548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 130/252] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:20.622572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab05f10-e1f8-4531-8184-c032624e14ee None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:20.649146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b49d-1d94-43e8-a643-11dd0499a8a6 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:20.694761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea56925-baa8-45a9-8923-a32dfdaa182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:20.695413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea56925-baa8-45a9-8923-a32dfdaa182f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.695721 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea56925-baa8-45a9-8923-a32dfdaa182f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.696004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea56925-baa8-45a9-8923-a32dfdaa182f None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.697175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea56925-baa8-45a9-8923-a32dfdaa182f None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:20.699332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea56925-baa8-45a9-8923-a32dfdaa182f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:20.701833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 123/253] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:20 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:20.707360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea56925-baa8-45a9-8923-a32dfdaa182f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:20.778676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab05f10-e1f8-4531-8184-c032624e14ee None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:20.782508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:20.791351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:20.829084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f79e9-2649-4652-bbcd-573246ec85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:20.830374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f79e9-2649-4652-bbcd-573246ec85c0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.831075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f79e9-2649-4652-bbcd-573246ec85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.831535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f79e9-2649-4652-bbcd-573246ec85c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.832468 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f79e9-2649-4652-bbcd-573246ec85c0 None admin] RBAC: Adding query filter params (role.id=accf76b1c5d94b02b8e0650939fab7f9, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7, user.id=f8dea064eec34144b79b99dd97bfac8f) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:20.832972 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f79e9-2649-4652-bbcd-573246ec85c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:20.834593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f79e9-2649-4652-bbcd-573246ec85c0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:20.836112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea56925-baa8-45a9-8923-a32dfdaa182f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:20.843031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 131/254] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:20 2022] GET /identity/v3/role_assignments?user.id=f8dea064eec34144b79b99dd97bfac8f&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=accf76b1c5d94b02b8e0650939fab7f9 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:20.845133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77432f12-047e-456a-a51d-268d4dbe6a51 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.845632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77432f12-047e-456a-a51d-268d4dbe6a51 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.846081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77432f12-047e-456a-a51d-268d4dbe6a51 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.848171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 132/255] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:20.854722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e0cba-43f1-4da8-b875-0e71c7a7a3d5 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.855029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e0cba-43f1-4da8-b875-0e71c7a7a3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.855285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e0cba-43f1-4da8-b875-0e71c7a7a3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.876949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-0a9e0cba-43f1-4da8-b875-0e71c7a7a3d5 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:20.878232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0a9e0cba-43f1-4da8-b875-0e71c7a7a3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:20.887315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dbfbe-3138-45fb-bd0a-af3ef4b41348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:20.888392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dbfbe-3138-45fb-bd0a-af3ef4b41348 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:20.888898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dbfbe-3138-45fb-bd0a-af3ef4b41348 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:20.889372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dbfbe-3138-45fb-bd0a-af3ef4b41348 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/users/f8c0b2de9d57476885e75a98b2371c0e/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:20.891596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959dbfbe-3138-45fb-bd0a-af3ef4b41348 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e03e1ea52d44839b4e066f2427b2e7, user_id=f8c0b2de9d57476885e75a98b2371c0e, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:20.893346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959dbfbe-3138-45fb-bd0a-af3ef4b41348 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:20.971607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 124/256] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:58:20 2022] PUT /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/users/f8c0b2de9d57476885e75a98b2371c0e/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:20.971964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 133/257] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:20.974750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e0cba-43f1-4da8-b875-0e71c7a7a3d5 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:21.115079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e0cba-43f1-4da8-b875-0e71c7a7a3d5 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:21.124069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:21.159918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5596e-eab3-4a17-a041-548daba272c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:21.160543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5596e-eab3-4a17-a041-548daba272c1 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:21.160769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5596e-eab3-4a17-a041-548daba272c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:21.161050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5596e-eab3-4a17-a041-548daba272c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:21.177704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5596e-eab3-4a17-a041-548daba272c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-45f5596e-eab3-4a17-a041-548daba272c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:21.182806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:21.183756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:21.184562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 134/258] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:21.190460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dbfbe-3138-45fb-bd0a-af3ef4b41348 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:21.326908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5596e-eab3-4a17-a041-548daba272c1 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:21.357862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dbfbe-3138-45fb-bd0a-af3ef4b41348 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:21.398820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:21.435724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04ba1-52cb-40bb-8e7d-9efda4f5cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:21.436274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04ba1-52cb-40bb-8e7d-9efda4f5cd0d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:21.436555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04ba1-52cb-40bb-8e7d-9efda4f5cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:21.436828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04ba1-52cb-40bb-8e7d-9efda4f5cd0d None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:21.437502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de04ba1-52cb-40bb-8e7d-9efda4f5cd0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:21.437808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de04ba1-52cb-40bb-8e7d-9efda4f5cd0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:21.439210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de04ba1-52cb-40bb-8e7d-9efda4f5cd0d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:21.457367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 125/259] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:21.463986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04ba1-52cb-40bb-8e7d-9efda4f5cd0d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:21.535759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5596e-eab3-4a17-a041-548daba272c1 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:21.628423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56484c-fbd2-4919-a0da-0c19f18a53d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:21.629167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56484c-fbd2-4919-a0da-0c19f18a53d2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:21.629443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56484c-fbd2-4919-a0da-0c19f18a53d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:21.629716 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56484c-fbd2-4919-a0da-0c19f18a53d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:21.650774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56484c-fbd2-4919-a0da-0c19f18a53d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-6c56484c-fbd2-4919-a0da-0c19f18a53d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:21.655678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:21.656555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:21.657815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 135/260] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:58:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:21.666110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56484c-fbd2-4919-a0da-0c19f18a53d2 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:21.712831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:21.730551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04ba1-52cb-40bb-8e7d-9efda4f5cd0d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:21.801003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea0e74-e8a6-4ac8-b91b-d8a3a39cefb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:21.802048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea0e74-e8a6-4ac8-b91b-d8a3a39cefb6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:21.802471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea0e74-e8a6-4ac8-b91b-d8a3a39cefb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:21.802762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea0e74-e8a6-4ac8-b91b-d8a3a39cefb6 None admin] PATH_INFO: `/v3/users/6f64c43fee3645adbd083253dd0231ad` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:21.804982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea0e74-e8a6-4ac8-b91b-d8a3a39cefb6 None admin] RBAC: Authorizing `identity:get_user(user_id=6f64c43fee3645adbd083253dd0231ad)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:21.806457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea0e74-e8a6-4ac8-b91b-d8a3a39cefb6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:21.808574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 126/261] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:21 2022] GET /identity/v3/users/6f64c43fee3645adbd083253dd0231ad => generated 283 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:21.814711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea0e74-e8a6-4ac8-b91b-d8a3a39cefb6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:21.907008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:21.945842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56484c-fbd2-4919-a0da-0c19f18a53d2 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:21.995423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea0e74-e8a6-4ac8-b91b-d8a3a39cefb6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:22.048734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ad386-be56-4fef-8830-50823c0704a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:22.049475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ad386-be56-4fef-8830-50823c0704a2 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:22.049860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ad386-be56-4fef-8830-50823c0704a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:22.050146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ad386-be56-4fef-8830-50823c0704a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:22.051942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99444306-9835-4d54-81b7-ffcfaba141d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:22.052573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99444306-9835-4d54-81b7-ffcfaba141d5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:22.052855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99444306-9835-4d54-81b7-ffcfaba141d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:22.053132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99444306-9835-4d54-81b7-ffcfaba141d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:22.053844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99444306-9835-4d54-81b7-ffcfaba141d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:22.054153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99444306-9835-4d54-81b7-ffcfaba141d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:22.055568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99444306-9835-4d54-81b7-ffcfaba141d5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:22.086607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 136/262] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:22.092116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99444306-9835-4d54-81b7-ffcfaba141d5 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:22.208152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:22.214027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ad386-be56-4fef-8830-50823c0704a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:22.215532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ad386-be56-4fef-8830-50823c0704a2 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:22.228844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99444306-9835-4d54-81b7-ffcfaba141d5 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:22.267510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906fee0-3771-46db-a284-b23dca45b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:22.268105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906fee0-3771-46db-a284-b23dca45b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:22.268390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906fee0-3771-46db-a284-b23dca45b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:22.268673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906fee0-3771-46db-a284-b23dca45b0a7 None admin] PATH_INFO: `/v3/users/6f64c43fee3645adbd083253dd0231ad` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:22.269825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906fee0-3771-46db-a284-b23dca45b0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=6f64c43fee3645adbd083253dd0231ad)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:22.271418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906fee0-3771-46db-a284-b23dca45b0a7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:22.273896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 137/263] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:22 2022] GET /identity/v3/users/6f64c43fee3645adbd083253dd0231ad => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:22.279324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906fee0-3771-46db-a284-b23dca45b0a7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:22.348272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:22.418128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906fee0-3771-46db-a284-b23dca45b0a7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:22.481355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb037b1e-0e55-4e8d-9988-2a011624b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:22.481985 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb037b1e-0e55-4e8d-9988-2a011624b744 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:22.482265 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb037b1e-0e55-4e8d-9988-2a011624b744 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:22.482539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb037b1e-0e55-4e8d-9988-2a011624b744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:22.494403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 127/264] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:22.501171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ad386-be56-4fef-8830-50823c0704a2 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:22.514555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:22.603055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb037b1e-0e55-4e8d-9988-2a011624b744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:22.604916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb037b1e-0e55-4e8d-9988-2a011624b744 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:22.700737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ad386-be56-4fef-8830-50823c0704a2 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:22.768132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 138/265] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:58:22.777043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb037b1e-0e55-4e8d-9988-2a011624b744 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:22.800499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5cfaf-118a-46fa-aab0-22a77a3ab1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:22.801166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5cfaf-118a-46fa-aab0-22a77a3ab1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:22.801435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5cfaf-118a-46fa-aab0-22a77a3ab1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:22.801714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5cfaf-118a-46fa-aab0-22a77a3ab1a1 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:22.802919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5cfaf-118a-46fa-aab0-22a77a3ab1a1 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:22.804942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5cfaf-118a-46fa-aab0-22a77a3ab1a1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:22.806589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 128/266] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:22 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:22.812578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5cfaf-118a-46fa-aab0-22a77a3ab1a1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:22.861123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:22.877052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:22.978943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb037b1e-0e55-4e8d-9988-2a011624b744 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:23.047042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5cfaf-118a-46fa-aab0-22a77a3ab1a1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:23.057721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09662efd-53d8-49b8-ad33-dbd20b9a6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:23.058378 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09662efd-53d8-49b8-ad33-dbd20b9a6af7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:23.058686 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09662efd-53d8-49b8-ad33-dbd20b9a6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:23.058935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09662efd-53d8-49b8-ad33-dbd20b9a6af7 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:23.064368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09662efd-53d8-49b8-ad33-dbd20b9a6af7 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:23.065824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09662efd-53d8-49b8-ad33-dbd20b9a6af7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:23.067517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 139/267] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:22 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:23.073611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09662efd-53d8-49b8-ad33-dbd20b9a6af7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:23.109189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc6464-f253-4aa6-930c-5e0bce76c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:23.109857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc6464-f253-4aa6-930c-5e0bce76c70d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:23.110146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc6464-f253-4aa6-930c-5e0bce76c70d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:23.110423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc6464-f253-4aa6-930c-5e0bce76c70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:23.111213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc6464-f253-4aa6-930c-5e0bce76c70d None admin] RBAC: Adding query filter params (role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7, user.id=6f64c43fee3645adbd083253dd0231ad) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:23.111472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc6464-f253-4aa6-930c-5e0bce76c70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:23.112997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc6464-f253-4aa6-930c-5e0bce76c70d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:23.127373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 129/268] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:22 2022] GET /identity/v3/role_assignments?user.id=6f64c43fee3645adbd083253dd0231ad&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=1387b2da4fc147fe99310c8bea8504be => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:23.273733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09662efd-53d8-49b8-ad33-dbd20b9a6af7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:23.298103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:23.322021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0204-3e5b-4325-a131-b54e7bcdf2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:23.322761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0204-3e5b-4325-a131-b54e7bcdf2ff None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:23.323044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0204-3e5b-4325-a131-b54e7bcdf2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:23.323317 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0204-3e5b-4325-a131-b54e7bcdf2ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:23.324086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe0204-3e5b-4325-a131-b54e7bcdf2ff None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7, user.id=6f64c43fee3645adbd083253dd0231ad) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:23.324397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe0204-3e5b-4325-a131-b54e7bcdf2ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:23.325876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe0204-3e5b-4325-a131-b54e7bcdf2ff None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:23.338320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 140/269] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:23 2022] GET /identity/v3/role_assignments?user.id=6f64c43fee3645adbd083253dd0231ad&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=06592016669243d99b430c46dd1c1d46 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:23.754113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc29bec-daee-40eb-861d-4f6c65a93a40 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:23.754507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc29bec-daee-40eb-861d-4f6c65a93a40 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:23.754702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc29bec-daee-40eb-861d-4f6c65a93a40 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:23.756214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 130/270] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:23.762844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff962b-ddf4-4e05-9803-7228fe446d67 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:23.763133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff962b-ddf4-4e05-9803-7228fe446d67 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:23.763414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff962b-ddf4-4e05-9803-7228fe446d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:23.783797 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-47ff962b-ddf4-4e05-9803-7228fe446d67 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:23.785032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-47ff962b-ddf4-4e05-9803-7228fe446d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:23.856467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 141/271] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:24.026590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c53855-867f-428a-829d-b9bbb141826d None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.027084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c53855-867f-428a-829d-b9bbb141826d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.027084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c53855-867f-428a-829d-b9bbb141826d None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.028418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 131/272] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:24.034129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dd62d-7b35-4fd8-8162-af06ea8fb802 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.034491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dd62d-7b35-4fd8-8162-af06ea8fb802 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.034772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dd62d-7b35-4fd8-8162-af06ea8fb802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.055592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-588dd62d-7b35-4fd8-8162-af06ea8fb802 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:24.056819 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-588dd62d-7b35-4fd8-8162-af06ea8fb802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:24.105487 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766e323-4379-4b1c-a926-4702e294c07e None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.105806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766e323-4379-4b1c-a926-4702e294c07e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.106040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766e323-4379-4b1c-a926-4702e294c07e None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.107766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 132/273] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:24.113571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18973e-e7b6-42cf-a755-c8198a2af40f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.114194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18973e-e7b6-42cf-a755-c8198a2af40f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.114687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18973e-e7b6-42cf-a755-c8198a2af40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.138202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8e18973e-e7b6-42cf-a755-c8198a2af40f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:24.140039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8e18973e-e7b6-42cf-a755-c8198a2af40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:24.141253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 142/274] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:24.183902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dd62d-7b35-4fd8-8162-af06ea8fb802 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.213250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 133/275] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:24.224083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe161-a5b4-479e-84df-228812132db6 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.224626 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe161-a5b4-479e-84df-228812132db6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.225050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe161-a5b4-479e-84df-228812132db6 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.226847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 134/276] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:24.231775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:24.233850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475ae1-4c6c-485d-bb43-cd5a4dfbee28 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.234307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475ae1-4c6c-485d-bb43-cd5a4dfbee28 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.234728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475ae1-4c6c-485d-bb43-cd5a4dfbee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.253969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-81475ae1-4c6c-485d-bb43-cd5a4dfbee28 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:24.255502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-81475ae1-4c6c-485d-bb43-cd5a4dfbee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:24.266114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:24.295414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dd62d-7b35-4fd8-8162-af06ea8fb802 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.335687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 135/277] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:24.339505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfc314-31e8-406f-b25a-8fb4dc6a65ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:24.340445 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc314-31e8-406f-b25a-8fb4dc6a65ae None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.340921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc314-31e8-406f-b25a-8fb4dc6a65ae None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.341413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc314-31e8-406f-b25a-8fb4dc6a65ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.353579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfc314-31e8-406f-b25a-8fb4dc6a65ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-20bfc314-31e8-406f-b25a-8fb4dc6a65ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:24.358993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:24.359912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:24.360779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:24.363120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 143/278] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:24.369279 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475ae1-4c6c-485d-bb43-cd5a4dfbee28 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.417674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfc314-31e8-406f-b25a-8fb4dc6a65ae None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.486429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475ae1-4c6c-485d-bb43-cd5a4dfbee28 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.522025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0ae7-8dd1-4cdd-97ee-a56f9dde4d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:24.523661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0ae7-8dd1-4cdd-97ee-a56f9dde4d63 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.523943 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0ae7-8dd1-4cdd-97ee-a56f9dde4d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.524219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0ae7-8dd1-4cdd-97ee-a56f9dde4d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.524880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef0ae7-8dd1-4cdd-97ee-a56f9dde4d63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:24.525181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef0ae7-8dd1-4cdd-97ee-a56f9dde4d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:24.526772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef0ae7-8dd1-4cdd-97ee-a56f9dde4d63 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:24.531929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfc314-31e8-406f-b25a-8fb4dc6a65ae None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.533480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:24.536250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 136/279] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:24.537330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0ae7-8dd1-4cdd-97ee-a56f9dde4d63 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.544906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:24.566314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5afa02-ca1f-492d-956d-b1aa0394135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:24.566949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5afa02-ca1f-492d-956d-b1aa0394135e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.567229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5afa02-ca1f-492d-956d-b1aa0394135e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.567829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5afa02-ca1f-492d-956d-b1aa0394135e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.578450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5afa02-ca1f-492d-956d-b1aa0394135e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-da5afa02-ca1f-492d-956d-b1aa0394135e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:24.583243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:24.584203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:24.584992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 144/280] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:24.586155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5afa02-ca1f-492d-956d-b1aa0394135e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.651338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0ae7-8dd1-4cdd-97ee-a56f9dde4d63 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.683686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2f8f6-19bd-4960-84c9-f8b38a029c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:24.684320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2f8f6-19bd-4960-84c9-f8b38a029c1e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.684603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2f8f6-19bd-4960-84c9-f8b38a029c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.684878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2f8f6-19bd-4960-84c9-f8b38a029c1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.686657 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5afa02-ca1f-492d-956d-b1aa0394135e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.695249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2f8f6-19bd-4960-84c9-f8b38a029c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-eec2f8f6-19bd-4960-84c9-f8b38a029c1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:24.700551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:24.701527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:24.702350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 137/281] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:24.702996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2f8f6-19bd-4960-84c9-f8b38a029c1e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.722648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb5f3-5936-43c5-a50c-f12ea8519791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:24.723278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb5f3-5936-43c5-a50c-f12ea8519791 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.723559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb5f3-5936-43c5-a50c-f12ea8519791 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.723865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb5f3-5936-43c5-a50c-f12ea8519791 None admin] PATH_INFO: `/v3/users/f8dea064eec34144b79b99dd97bfac8f` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.724992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55eb5f3-5936-43c5-a50c-f12ea8519791 None admin] RBAC: Authorizing `identity:get_user(user_id=f8dea064eec34144b79b99dd97bfac8f)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:24.726457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55eb5f3-5936-43c5-a50c-f12ea8519791 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:24.728049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 145/282] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/users/f8dea064eec34144b79b99dd97bfac8f => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:24.728810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb5f3-5936-43c5-a50c-f12ea8519791 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.758560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:24.767089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:24.803480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2f8f6-19bd-4960-84c9-f8b38a029c1e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.826904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb5f3-5936-43c5-a50c-f12ea8519791 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.837011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c8cc5-a47e-44f4-8e20-becb21c44e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:24.837618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c8cc5-a47e-44f4-8e20-becb21c44e0e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.837903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c8cc5-a47e-44f4-8e20-becb21c44e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.838169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c8cc5-a47e-44f4-8e20-becb21c44e0e None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.838819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c8cc5-a47e-44f4-8e20-becb21c44e0e None admin] RBAC: Adding query filter params (name=member) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:24.839119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c8cc5-a47e-44f4-8e20-becb21c44e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:24.840516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c8cc5-a47e-44f4-8e20-becb21c44e0e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:24.848677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 138/283] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:24.849287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c8cc5-a47e-44f4-8e20-becb21c44e0e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.862594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b078bb8-5821-450d-b44a-7f2f477dd45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:24.863258 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b078bb8-5821-450d-b44a-7f2f477dd45c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.863541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b078bb8-5821-450d-b44a-7f2f477dd45c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.863871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b078bb8-5821-450d-b44a-7f2f477dd45c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.864982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b078bb8-5821-450d-b44a-7f2f477dd45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:24.866426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b078bb8-5821-450d-b44a-7f2f477dd45c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:24.868012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 146/284] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:24.868773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b078bb8-5821-450d-b44a-7f2f477dd45c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.952040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c8cc5-a47e-44f4-8e20-becb21c44e0e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.964332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:24.968358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b078bb8-5821-450d-b44a-7f2f477dd45c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.978511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:24.986620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8fd28-5408-42fe-9d4b-7e99ad6ce894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:24.987234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8fd28-5408-42fe-9d4b-7e99ad6ce894 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.987518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8fd28-5408-42fe-9d4b-7e99ad6ce894 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.987825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8fd28-5408-42fe-9d4b-7e99ad6ce894 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.988486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8fd28-5408-42fe-9d4b-7e99ad6ce894 None admin] RBAC: Adding query filter params (name=member) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:24.988793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8fd28-5408-42fe-9d4b-7e99ad6ce894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:24.990171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8fd28-5408-42fe-9d4b-7e99ad6ce894 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:24.998918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 139/285] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:24.999741 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8fd28-5408-42fe-9d4b-7e99ad6ce894 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:25.002410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ecac7-4728-4392-a7ec-fcdec7149b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:25.003049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ecac7-4728-4392-a7ec-fcdec7149b68 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:25.003330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ecac7-4728-4392-a7ec-fcdec7149b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:25.003648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ecac7-4728-4392-a7ec-fcdec7149b68 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:25.004810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ecac7-4728-4392-a7ec-fcdec7149b68 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:25.006239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ecac7-4728-4392-a7ec-fcdec7149b68 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:25.008634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 147/286] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:25.009285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ecac7-4728-4392-a7ec-fcdec7149b68 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:25.101674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8fd28-5408-42fe-9d4b-7e99ad6ce894 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:25.111142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ecac7-4728-4392-a7ec-fcdec7149b68 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:25.137057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43994f60-0d1c-460a-a70f-38783ec12fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:25.137700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43994f60-0d1c-460a-a70f-38783ec12fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:25.137985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43994f60-0d1c-460a-a70f-38783ec12fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:25.138265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43994f60-0d1c-460a-a70f-38783ec12fb1 None admin] PATH_INFO: `/v3/users/36baa4b9019e4d60b4be57fbe386b37c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:25.149017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6c948-9620-499a-85fc-ebadc279233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:25.149630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6c948-9620-499a-85fc-ebadc279233d None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:25.149912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6c948-9620-499a-85fc-ebadc279233d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:25.150189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6c948-9620-499a-85fc-ebadc279233d None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:25.150839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6c948-9620-499a-85fc-ebadc279233d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:25.152315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6c948-9620-499a-85fc-ebadc279233d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:25.152429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43994f60-0d1c-460a-a70f-38783ec12fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=36baa4b9019e4d60b4be57fbe386b37c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:25.153866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43994f60-0d1c-460a-a70f-38783ec12fb1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:25.155506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 140/287] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/users/36baa4b9019e4d60b4be57fbe386b37c => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:25.156324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43994f60-0d1c-460a-a70f-38783ec12fb1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:25.201971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:25.252445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43994f60-0d1c-460a-a70f-38783ec12fb1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:25.271673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 148/288] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:58:25 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:25.271673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6c948-9620-499a-85fc-ebadc279233d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:25.296857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:25.311013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad200ab9-4a9d-42ab-a147-ff02a4954b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:25.311888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad200ab9-4a9d-42ab-a147-ff02a4954b82 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:25.312175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad200ab9-4a9d-42ab-a147-ff02a4954b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:25.312453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad200ab9-4a9d-42ab-a147-ff02a4954b82 None admin] PATH_INFO: `/v3/users/f8c0b2de9d57476885e75a98b2371c0e` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:25.313679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad200ab9-4a9d-42ab-a147-ff02a4954b82 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c0b2de9d57476885e75a98b2371c0e)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:25.315268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad200ab9-4a9d-42ab-a147-ff02a4954b82 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:25.317499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 141/289] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:25 2022] GET /identity/v3/users/f8c0b2de9d57476885e75a98b2371c0e => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:25.318338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad200ab9-4a9d-42ab-a147-ff02a4954b82 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:25.393420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6c948-9620-499a-85fc-ebadc279233d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:25.433262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae6da-479a-46c2-a7da-2d02bb8f57e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:25.433955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae6da-479a-46c2-a7da-2d02bb8f57e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:25.434239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae6da-479a-46c2-a7da-2d02bb8f57e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:25.434516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae6da-479a-46c2-a7da-2d02bb8f57e3 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/users/f8dea064eec34144b79b99dd97bfac8f/roles/accf76b1c5d94b02b8e0650939fab7f9` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:25.436567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbae6da-479a-46c2-a7da-2d02bb8f57e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e03e1ea52d44839b4e066f2427b2e7, user_id=f8dea064eec34144b79b99dd97bfac8f, role_id=accf76b1c5d94b02b8e0650939fab7f9)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:25.437379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad200ab9-4a9d-42ab-a147-ff02a4954b82 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:25.438048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbae6da-479a-46c2-a7da-2d02bb8f57e3 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:25.454444 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:25.475853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c8bec-4ea8-4f6f-840e-ac3abe20021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:25.476718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c8bec-4ea8-4f6f-840e-ac3abe20021c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:25.477000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c8bec-4ea8-4f6f-840e-ac3abe20021c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:25.477278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c8bec-4ea8-4f6f-840e-ac3abe20021c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:25.478367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c8bec-4ea8-4f6f-840e-ac3abe20021c None admin] RBAC: Adding query filter params (role.id=df79e12324de40afbb353b95363811cc, user.id=36baa4b9019e4d60b4be57fbe386b37c, scope.system=all) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:25.478367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c8bec-4ea8-4f6f-840e-ac3abe20021c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:25.479783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c8bec-4ea8-4f6f-840e-ac3abe20021c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:25.485120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 142/290] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Sep 9 11:58:25 2022] GET /identity/v3/role_assignments?user.id=36baa4b9019e4d60b4be57fbe386b37c&scope.system=all&role.id=df79e12324de40afbb353b95363811cc => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:25.485919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c8bec-4ea8-4f6f-840e-ac3abe20021c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:25.521885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 149/291] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:58:25 2022] PUT /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/users/f8dea064eec34144b79b99dd97bfac8f/roles/accf76b1c5d94b02b8e0650939fab7f9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:25.625374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c8bec-4ea8-4f6f-840e-ac3abe20021c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:25.670664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f40a1-713e-4341-ba1d-372e9cac6de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:25.671220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f40a1-713e-4341-ba1d-372e9cac6de1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:25.671505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f40a1-713e-4341-ba1d-372e9cac6de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:25.671879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f40a1-713e-4341-ba1d-372e9cac6de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:25.729127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:25.754675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f40a1-713e-4341-ba1d-372e9cac6de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:25.756261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f40a1-713e-4341-ba1d-372e9cac6de1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:25.861058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 143/292] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:25.866319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae6da-479a-46c2-a7da-2d02bb8f57e3 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:25.962270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:25.985733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae6da-479a-46c2-a7da-2d02bb8f57e3 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:26.041681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275481d1-e7d6-498b-93ee-5b371b7c8d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:26.042331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275481d1-e7d6-498b-93ee-5b371b7c8d54 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:26.042615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275481d1-e7d6-498b-93ee-5b371b7c8d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:26.042889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275481d1-e7d6-498b-93ee-5b371b7c8d54 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:26.044135 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275481d1-e7d6-498b-93ee-5b371b7c8d54 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:26.045559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275481d1-e7d6-498b-93ee-5b371b7c8d54 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:26.047452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 150/293] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:25 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:26.053694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f40a1-713e-4341-ba1d-372e9cac6de1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:26.165479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:26.190283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f40a1-713e-4341-ba1d-372e9cac6de1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:26.250522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080014e2-eb24-4ad2-9323-d1811640f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:26.251463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080014e2-eb24-4ad2-9323-d1811640f799 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:26.251984 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080014e2-eb24-4ad2-9323-d1811640f799 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:26.252467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080014e2-eb24-4ad2-9323-d1811640f799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:26.253392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080014e2-eb24-4ad2-9323-d1811640f799 None admin] RBAC: Adding query filter params (role.id=df79e12324de40afbb353b95363811cc, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7, user.id=f8c0b2de9d57476885e75a98b2371c0e) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:26.253920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080014e2-eb24-4ad2-9323-d1811640f799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:26.255576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080014e2-eb24-4ad2-9323-d1811640f799 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:26.266605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 144/294] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:26 2022] GET /identity/v3/role_assignments?user.id=f8c0b2de9d57476885e75a98b2371c0e&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=df79e12324de40afbb353b95363811cc => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:28.032224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ccff3-a658-4d29-b279-c4f1af5bec61 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.032224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ccff3-a658-4d29-b279-c4f1af5bec61 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.032224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ccff3-a658-4d29-b279-c4f1af5bec61 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.032224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 151/295] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:28.038090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656596c3-5022-4bb6-a8a4-6e294004a5fb None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.039080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656596c3-5022-4bb6-a8a4-6e294004a5fb None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.039295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656596c3-5022-4bb6-a8a4-6e294004a5fb None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.040857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 145/296] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:28.041318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a245-957f-4926-a813-a6eb8317ed5b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.041611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a245-957f-4926-a813-a6eb8317ed5b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.041895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a245-957f-4926-a813-a6eb8317ed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.048852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec40f48-1cd4-439d-8237-b2ae3a4f1dd0 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.049396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec40f48-1cd4-439d-8237-b2ae3a4f1dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.049824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec40f48-1cd4-439d-8237-b2ae3a4f1dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.060991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-fd30a245-957f-4926-a813-a6eb8317ed5b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:28.062180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fd30a245-957f-4926-a813-a6eb8317ed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:28.071249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-dec40f48-1cd4-439d-8237-b2ae3a4f1dd0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:28.072906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-dec40f48-1cd4-439d-8237-b2ae3a4f1dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:28.143973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 152/297] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:28.144194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce30d4a-b147-48af-9234-905ad1e1a0bb None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.144544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce30d4a-b147-48af-9234-905ad1e1a0bb None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.144918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce30d4a-b147-48af-9234-905ad1e1a0bb None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.146399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 153/298] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:28.152455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af7e5-c4a7-497c-9d7e-40396159abbc None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.152952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af7e5-c4a7-497c-9d7e-40396159abbc None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.153426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af7e5-c4a7-497c-9d7e-40396159abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.167997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 146/299] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:28.172740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6f8af7e5-c4a7-497c-9d7e-40396159abbc None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:28.174161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6f8af7e5-c4a7-497c-9d7e-40396159abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:28.201845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba8809-ed27-4b02-8761-bc04aa8a7d93 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.202121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba8809-ed27-4b02-8761-bc04aa8a7d93 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.202661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba8809-ed27-4b02-8761-bc04aa8a7d93 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.204245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 147/300] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:28.213143 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeed76d-c464-479a-97e4-fbabe368d62c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.213688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeed76d-c464-479a-97e4-fbabe368d62c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.214150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeed76d-c464-479a-97e4-fbabe368d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.238243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-baeed76d-c464-479a-97e4-fbabe368d62c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:28.240563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-baeed76d-c464-479a-97e4-fbabe368d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:28.251925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 154/301] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:28.313634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 148/302] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:28.425728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af7e5-c4a7-497c-9d7e-40396159abbc None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:28.431690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeed76d-c464-479a-97e4-fbabe368d62c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:28.434597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:28.441145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:28.540055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af7e5-c4a7-497c-9d7e-40396159abbc None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:28.558873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeed76d-c464-479a-97e4-fbabe368d62c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:28.576551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972e543-c905-4c4d-ab40-131b8961079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:28.577193 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972e543-c905-4c4d-ab40-131b8961079e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.577473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972e543-c905-4c4d-ab40-131b8961079e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.577739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972e543-c905-4c4d-ab40-131b8961079e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.589298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972e543-c905-4c4d-ab40-131b8961079e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-e972e543-c905-4c4d-ab40-131b8961079e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:28.594169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:28.595039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:28.600617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 155/303] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:28.601480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee1f88-8dd7-49e4-9b17-77732cc9649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:28.601480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee1f88-8dd7-49e4-9b17-77732cc9649c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.601658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972e543-c905-4c4d-ab40-131b8961079e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:28.601738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee1f88-8dd7-49e4-9b17-77732cc9649c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.601738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee1f88-8dd7-49e4-9b17-77732cc9649c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.606843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee1f88-8dd7-49e4-9b17-77732cc9649c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-c5ee1f88-8dd7-49e4-9b17-77732cc9649c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:28.611563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:28.612668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 149/304] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:28.613678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee1f88-8dd7-49e4-9b17-77732cc9649c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:28.671528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:28.675816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:28.701203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972e543-c905-4c4d-ab40-131b8961079e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:28.713409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee1f88-8dd7-49e4-9b17-77732cc9649c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:28.734811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997cc95-1d62-4e94-bd46-4dfdbc963a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:28.735546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997cc95-1d62-4e94-bd46-4dfdbc963a65 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.735866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997cc95-1d62-4e94-bd46-4dfdbc963a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.736145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997cc95-1d62-4e94-bd46-4dfdbc963a65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.737255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997cc95-1d62-4e94-bd46-4dfdbc963a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:28.738689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997cc95-1d62-4e94-bd46-4dfdbc963a65 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:28.740278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 156/305] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:28.741040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997cc95-1d62-4e94-bd46-4dfdbc963a65 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:28.749708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea98a2-3c6f-4ce0-b7d6-59f3c316ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:28.750335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea98a2-3c6f-4ce0-b7d6-59f3c316ea55 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.750613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea98a2-3c6f-4ce0-b7d6-59f3c316ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.750884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea98a2-3c6f-4ce0-b7d6-59f3c316ea55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.760899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea98a2-3c6f-4ce0-b7d6-59f3c316ea55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-5dea98a2-3c6f-4ce0-b7d6-59f3c316ea55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:28.765634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:28.766684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:28.767517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 150/306] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:28.768209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea98a2-3c6f-4ce0-b7d6-59f3c316ea55 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:28.845375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997cc95-1d62-4e94-bd46-4dfdbc963a65 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:28.866715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea98a2-3c6f-4ce0-b7d6-59f3c316ea55 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:28.880127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f931c6e-f880-4805-9f97-5c2c30853124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:28.880768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f931c6e-f880-4805-9f97-5c2c30853124 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.881041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f931c6e-f880-4805-9f97-5c2c30853124 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.881315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f931c6e-f880-4805-9f97-5c2c30853124 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.881977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f931c6e-f880-4805-9f97-5c2c30853124 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:28.882280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f931c6e-f880-4805-9f97-5c2c30853124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:28.883659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f931c6e-f880-4805-9f97-5c2c30853124 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:28.888632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:28.889674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:28.891918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 157/307] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:28.892676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f931c6e-f880-4805-9f97-5c2c30853124 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:28.902805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee656948-5bc6-43b3-8a4f-8675a80a86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:28.903419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee656948-5bc6-43b3-8a4f-8675a80a86dc None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:28.903733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee656948-5bc6-43b3-8a4f-8675a80a86dc None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:28.904041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee656948-5bc6-43b3-8a4f-8675a80a86dc None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:28.904716 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee656948-5bc6-43b3-8a4f-8675a80a86dc None admin] RBAC: Adding query filter params (name=member) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:28.905022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee656948-5bc6-43b3-8a4f-8675a80a86dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:28.906392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee656948-5bc6-43b3-8a4f-8675a80a86dc None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:28.915414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 151/308] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:28.916263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee656948-5bc6-43b3-8a4f-8675a80a86dc None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:28.991247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f931c6e-f880-4805-9f97-5c2c30853124 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:29.025023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc551a-1844-4857-8efa-49f6102a52f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:29.025631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc551a-1844-4857-8efa-49f6102a52f0 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:29.025912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc551a-1844-4857-8efa-49f6102a52f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:29.026377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc551a-1844-4857-8efa-49f6102a52f0 None admin] PATH_INFO: `/v3/groups` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:29.027014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc551a-1844-4857-8efa-49f6102a52f0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:29.028517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc551a-1844-4857-8efa-49f6102a52f0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:29.045295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee656948-5bc6-43b3-8a4f-8675a80a86dc None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:29.077476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c992c4-bc29-40f5-85a7-d0471791251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:29.078080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c992c4-bc29-40f5-85a7-d0471791251f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:29.078359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c992c4-bc29-40f5-85a7-d0471791251f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:29.078631 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c992c4-bc29-40f5-85a7-d0471791251f None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:29.079285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c992c4-bc29-40f5-85a7-d0471791251f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:29.079590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c992c4-bc29-40f5-85a7-d0471791251f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:29.080970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c992c4-bc29-40f5-85a7-d0471791251f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:29.089407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 152/309] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:29.090270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c992c4-bc29-40f5-85a7-d0471791251f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:29.124664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 158/310] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Sep 9 11:58:28 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:29.126019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc551a-1844-4857-8efa-49f6102a52f0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:29.141847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:29.199986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c992c4-bc29-40f5-85a7-d0471791251f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:29.201791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:29.238431 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae55fe-7bbd-4f12-ac7b-1dc24e486533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:29.239337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae55fe-7bbd-4f12-ac7b-1dc24e486533 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:29.239838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae55fe-7bbd-4f12-ac7b-1dc24e486533 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:29.240255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae55fe-7bbd-4f12-ac7b-1dc24e486533 None admin] PATH_INFO: `/v3/users/cb9001fb0cba477a8a3796cfcce79fa7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:29.247358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc551a-1844-4857-8efa-49f6102a52f0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:29.255840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae55fe-7bbd-4f12-ac7b-1dc24e486533 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9001fb0cba477a8a3796cfcce79fa7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:29.258239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae55fe-7bbd-4f12-ac7b-1dc24e486533 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:29.262755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 153/311] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:29 2022] GET /identity/v3/users/cb9001fb0cba477a8a3796cfcce79fa7 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:29.262755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae55fe-7bbd-4f12-ac7b-1dc24e486533 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:29.293003 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde9545-8c33-43ff-a267-fc57fc91e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:29.293662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde9545-8c33-43ff-a267-fc57fc91e052 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:29.293983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde9545-8c33-43ff-a267-fc57fc91e052 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:29.294249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde9545-8c33-43ff-a267-fc57fc91e052 None admin] PATH_INFO: `/v3/users/36baa4b9019e4d60b4be57fbe386b37c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:29.295440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde9545-8c33-43ff-a267-fc57fc91e052 None admin] RBAC: Authorizing `identity:get_user(user_id=36baa4b9019e4d60b4be57fbe386b37c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:29.296982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde9545-8c33-43ff-a267-fc57fc91e052 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:29.303337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 159/312] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:29 2022] GET /identity/v3/users/36baa4b9019e4d60b4be57fbe386b37c => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:29.303337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde9545-8c33-43ff-a267-fc57fc91e052 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:29.382821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae55fe-7bbd-4f12-ac7b-1dc24e486533 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:29.385049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:29.414773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde9545-8c33-43ff-a267-fc57fc91e052 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:29.416414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50553907-57ce-4d18-aeef-98d4807569af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:29.417127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50553907-57ce-4d18-aeef-98d4807569af None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:29.417406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50553907-57ce-4d18-aeef-98d4807569af None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:29.417683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50553907-57ce-4d18-aeef-98d4807569af None admin] PATH_INFO: `/v3/users/f8dea064eec34144b79b99dd97bfac8f` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:29.418824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50553907-57ce-4d18-aeef-98d4807569af None admin] RBAC: Authorizing `identity:get_user(user_id=f8dea064eec34144b79b99dd97bfac8f)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:29.420317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50553907-57ce-4d18-aeef-98d4807569af None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:29.421895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 154/313] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:29 2022] GET /identity/v3/users/f8dea064eec34144b79b99dd97bfac8f => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:29.422651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50553907-57ce-4d18-aeef-98d4807569af None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:29.448835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:29.458132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1138c2e-8ce7-4af1-9811-7b78b752abb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:29.459139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1138c2e-8ce7-4af1-9811-7b78b752abb3 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:29.459601 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1138c2e-8ce7-4af1-9811-7b78b752abb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:29.460143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1138c2e-8ce7-4af1-9811-7b78b752abb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:29.461622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1138c2e-8ce7-4af1-9811-7b78b752abb3 None admin] RBAC: Adding query filter params (role.id=accf76b1c5d94b02b8e0650939fab7f9, user.id=cb9001fb0cba477a8a3796cfcce79fa7, scope.system=all) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:29.462112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1138c2e-8ce7-4af1-9811-7b78b752abb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:29.463863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1138c2e-8ce7-4af1-9811-7b78b752abb3 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:29.469162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 160/314] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Sep 9 11:58:29 2022] GET /identity/v3/role_assignments?user.id=cb9001fb0cba477a8a3796cfcce79fa7&scope.system=all&role.id=accf76b1c5d94b02b8e0650939fab7f9 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:29.470197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1138c2e-8ce7-4af1-9811-7b78b752abb3 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:29.560396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50553907-57ce-4d18-aeef-98d4807569af None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:29.599926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1138c2e-8ce7-4af1-9811-7b78b752abb3 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:29.606026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a079d06-d9fb-4225-b490-d6dfdc91d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:29.607009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a079d06-d9fb-4225-b490-d6dfdc91d9d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:29.607502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a079d06-d9fb-4225-b490-d6dfdc91d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:29.607980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a079d06-d9fb-4225-b490-d6dfdc91d9d0 None admin] PATH_INFO: `/v3/system/users/36baa4b9019e4d60b4be57fbe386b37c/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:29.609803 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a079d06-d9fb-4225-b490-d6dfdc91d9d0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=36baa4b9019e4d60b4be57fbe386b37c, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:29.611480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a079d06-d9fb-4225-b490-d6dfdc91d9d0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:29.641493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913126b-83b8-4793-9a07-4a3c7d0f6f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:29.642056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913126b-83b8-4793-9a07-4a3c7d0f6f1b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:29.642457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913126b-83b8-4793-9a07-4a3c7d0f6f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:29.642666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913126b-83b8-4793-9a07-4a3c7d0f6f1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:29.707005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:29.717566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913126b-83b8-4793-9a07-4a3c7d0f6f1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:29.719028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913126b-83b8-4793-9a07-4a3c7d0f6f1b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:29.758345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 155/315] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Sep 9 11:58:29 2022] PUT /identity/v3/system/users/36baa4b9019e4d60b4be57fbe386b37c/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:29.837631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 161/316] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:29.843443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a079d06-d9fb-4225-b490-d6dfdc91d9d0 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:29.884817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:29.959129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a079d06-d9fb-4225-b490-d6dfdc91d9d0 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:29.995729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb6c94-5548-4304-8ed5-8eee7678d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:29.996415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb6c94-5548-4304-8ed5-8eee7678d9be None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:29.996699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb6c94-5548-4304-8ed5-8eee7678d9be None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:29.996973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb6c94-5548-4304-8ed5-8eee7678d9be None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:29.998096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb6c94-5548-4304-8ed5-8eee7678d9be None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:29.999842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb6c94-5548-4304-8ed5-8eee7678d9be None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:30.001847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 156/317] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:29 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:30.007881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913126b-83b8-4793-9a07-4a3c7d0f6f1b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:30.104444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:30.114123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913126b-83b8-4793-9a07-4a3c7d0f6f1b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:30.149799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e292-de56-4691-8827-ddf681ac37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:30.150550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e292-de56-4691-8827-ddf681ac37ea None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:30.150717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e292-de56-4691-8827-ddf681ac37ea None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:30.150993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e292-de56-4691-8827-ddf681ac37ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:30.151782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e292-de56-4691-8827-ddf681ac37ea None admin] RBAC: Adding query filter params (role.id=accf76b1c5d94b02b8e0650939fab7f9, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7, user.id=f8dea064eec34144b79b99dd97bfac8f) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:30.152093 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e292-de56-4691-8827-ddf681ac37ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:30.153579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e292-de56-4691-8827-ddf681ac37ea None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:30.159984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 162/318] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:58:30 2022] GET /identity/v3/role_assignments?user.id=f8dea064eec34144b79b99dd97bfac8f&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=accf76b1c5d94b02b8e0650939fab7f9 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:31.334623 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e2326-6b7f-4e11-bf8a-ad51182f2c3f None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:31.335183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e2326-6b7f-4e11-bf8a-ad51182f2c3f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:31.335183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e2326-6b7f-4e11-bf8a-ad51182f2c3f None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:31.337215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 157/319] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:31.342447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d145ee8-234d-4207-9c5b-f1fad025a838 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:31.342879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d145ee8-234d-4207-9c5b-f1fad025a838 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:31.343045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d145ee8-234d-4207-9c5b-f1fad025a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:31.361295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2d145ee8-234d-4207-9c5b-f1fad025a838 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:31.362453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2d145ee8-234d-4207-9c5b-f1fad025a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:31.432649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 163/320] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:31.702433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e2326-6b7f-4e11-bf8a-ad51182f2c3f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:31.720632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54047d-ac1d-4316-9791-297efd659189 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:31.720942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54047d-ac1d-4316-9791-297efd659189 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:31.721198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54047d-ac1d-4316-9791-297efd659189 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:31.722535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 164/321] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:31.727925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452dad8-f475-49b7-a25d-74e7bf3db636 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:31.728322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452dad8-f475-49b7-a25d-74e7bf3db636 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:31.728474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452dad8-f475-49b7-a25d-74e7bf3db636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:31.747106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2452dad8-f475-49b7-a25d-74e7bf3db636 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:31.747458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2452dad8-f475-49b7-a25d-74e7bf3db636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:31.816078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e2326-6b7f-4e11-bf8a-ad51182f2c3f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:31.818815 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:31.827676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 165/322] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:31.851536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af88463-a17a-4d2e-8a40-602f9b9e216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:31.852182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af88463-a17a-4d2e-8a40-602f9b9e216e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:31.852460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af88463-a17a-4d2e-8a40-602f9b9e216e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:31.852727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af88463-a17a-4d2e-8a40-602f9b9e216e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:31.853812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af88463-a17a-4d2e-8a40-602f9b9e216e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:31.855251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af88463-a17a-4d2e-8a40-602f9b9e216e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:31.861778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 158/323] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:31.862732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452dad8-f475-49b7-a25d-74e7bf3db636 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:31.881215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:31.969330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452dad8-f475-49b7-a25d-74e7bf3db636 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:32.005598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9d6bf-e878-4358-ac47-104bc5b3c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:32.006622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9d6bf-e878-4358-ac47-104bc5b3c6a0 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.007173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9d6bf-e878-4358-ac47-104bc5b3c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.008192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9d6bf-e878-4358-ac47-104bc5b3c6a0 None admin] PATH_INFO: `/v3/groups` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.009394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9d6bf-e878-4358-ac47-104bc5b3c6a0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:32.012104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9d6bf-e878-4358-ac47-104bc5b3c6a0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:32.036310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b086aa3-2652-4c72-bf4a-d55ff495e039 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.036553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b086aa3-2652-4c72-bf4a-d55ff495e039 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.036830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b086aa3-2652-4c72-bf4a-d55ff495e039 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.040233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 159/324] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:32.045704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c538b-76a0-4996-a505-f6e10a4840d2 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.045992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c538b-76a0-4996-a505-f6e10a4840d2 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.046261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c538b-76a0-4996-a505-f6e10a4840d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.065263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f69c538b-76a0-4996-a505-f6e10a4840d2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:32.066472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f69c538b-76a0-4996-a505-f6e10a4840d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:32.120054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 166/325] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Sep 9 11:58:31 2022] POST /identity/v3/groups => generated 226 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:58:32.120380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9d6bf-e878-4358-ac47-104bc5b3c6a0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:32.146177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 160/326] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:32.209995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:32.235781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9d6bf-e878-4358-ac47-104bc5b3c6a0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:32.273920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b9868-bf23-4137-b64c-b598c9befb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:32.274938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b9868-bf23-4137-b64c-b598c9befb36 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.275420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b9868-bf23-4137-b64c-b598c9befb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.275947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b9868-bf23-4137-b64c-b598c9befb36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.287771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b9868-bf23-4137-b64c-b598c9befb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-145b9868-bf23-4137-b64c-b598c9befb36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:32.293969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:32.294902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:32.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:32.297773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 167/327] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:32.303756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c538b-76a0-4996-a505-f6e10a4840d2 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:32.411928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c538b-76a0-4996-a505-f6e10a4840d2 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:32.413993 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:32.421232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b9868-bf23-4137-b64c-b598c9befb36 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:32.449288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518feba-4224-49d2-99f6-d2009d999477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:32.449912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518feba-4224-49d2-99f6-d2009d999477 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.450192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518feba-4224-49d2-99f6-d2009d999477 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.450465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518feba-4224-49d2-99f6-d2009d999477 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.451143 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518feba-4224-49d2-99f6-d2009d999477 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:32.451449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518feba-4224-49d2-99f6-d2009d999477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:32.453118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518feba-4224-49d2-99f6-d2009d999477 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:32.462900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 161/328] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:32.468852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518feba-4224-49d2-99f6-d2009d999477 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:32.586492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b9868-bf23-4137-b64c-b598c9befb36 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:32.594270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518feba-4224-49d2-99f6-d2009d999477 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:32.631426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21747078-b627-44aa-b4b0-e5122369bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:32.632224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21747078-b627-44aa-b4b0-e5122369bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.632504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21747078-b627-44aa-b4b0-e5122369bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.632779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21747078-b627-44aa-b4b0-e5122369bfc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.635828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:32.640592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe17f21-b2dc-4b75-b5b4-befe754d95d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:32.641244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17f21-b2dc-4b75-b5b4-befe754d95d9 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.641540 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17f21-b2dc-4b75-b5b4-befe754d95d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.641836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17f21-b2dc-4b75-b5b4-befe754d95d9 None admin] PATH_INFO: `/v3/users/cb9001fb0cba477a8a3796cfcce79fa7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.642969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe17f21-b2dc-4b75-b5b4-befe754d95d9 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9001fb0cba477a8a3796cfcce79fa7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:32.645126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe17f21-b2dc-4b75-b5b4-befe754d95d9 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:32.646131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 162/329] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:32 2022] GET /identity/v3/users/cb9001fb0cba477a8a3796cfcce79fa7 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:32.646585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21747078-b627-44aa-b4b0-e5122369bfc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-21747078-b627-44aa-b4b0-e5122369bfc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:32.652164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:32.653709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:32.654479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:32.655087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe17f21-b2dc-4b75-b5b4-befe754d95d9 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:32.655179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 168/330] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:32.662920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21747078-b627-44aa-b4b0-e5122369bfc0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:32.699302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:32.774943 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe17f21-b2dc-4b75-b5b4-befe754d95d9 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:32.782557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21747078-b627-44aa-b4b0-e5122369bfc0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:32.812142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2dcc3-3440-4cbe-819e-21092bd04cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:32.812898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2dcc3-3440-4cbe-819e-21092bd04cc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.813178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2dcc3-3440-4cbe-819e-21092bd04cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.813455 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2dcc3-3440-4cbe-819e-21092bd04cc5 None admin] PATH_INFO: `/v3/system/users/cb9001fb0cba477a8a3796cfcce79fa7/roles/accf76b1c5d94b02b8e0650939fab7f9` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.814991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2dcc3-3440-4cbe-819e-21092bd04cc5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cb9001fb0cba477a8a3796cfcce79fa7, role_id=accf76b1c5d94b02b8e0650939fab7f9)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:32.816895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2dcc3-3440-4cbe-819e-21092bd04cc5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:32.826008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803598f-db9b-4d6c-9c71-24a37c59d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:32.826931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803598f-db9b-4d6c-9c71-24a37c59d27e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.827391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803598f-db9b-4d6c-9c71-24a37c59d27e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.827898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803598f-db9b-4d6c-9c71-24a37c59d27e None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.828744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803598f-db9b-4d6c-9c71-24a37c59d27e None admin] RBAC: Adding query filter params (name=member) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:32.829262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803598f-db9b-4d6c-9c71-24a37c59d27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:32.830803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803598f-db9b-4d6c-9c71-24a37c59d27e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:32.841535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 169/331] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:32.847742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803598f-db9b-4d6c-9c71-24a37c59d27e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:32.895769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 163/332] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Sep 9 11:58:32 2022] PUT /identity/v3/system/users/cb9001fb0cba477a8a3796cfcce79fa7/roles/accf76b1c5d94b02b8e0650939fab7f9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:58:32.917665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:32.964807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803598f-db9b-4d6c-9c71-24a37c59d27e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:33.004733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cefa39-ac86-4594-8331-71ee8a341a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:33.005404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cefa39-ac86-4594-8331-71ee8a341a3b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:33.005696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cefa39-ac86-4594-8331-71ee8a341a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:33.005931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cefa39-ac86-4594-8331-71ee8a341a3b None admin] PATH_INFO: `/v3/users/36baa4b9019e4d60b4be57fbe386b37c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:33.007174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cefa39-ac86-4594-8331-71ee8a341a3b None admin] RBAC: Authorizing `identity:get_user(user_id=36baa4b9019e4d60b4be57fbe386b37c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:33.008749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cefa39-ac86-4594-8331-71ee8a341a3b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:33.010919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 170/333] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:32 2022] GET /identity/v3/users/36baa4b9019e4d60b4be57fbe386b37c => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:33.016983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2dcc3-3440-4cbe-819e-21092bd04cc5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:33.140616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:33.147712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2dcc3-3440-4cbe-819e-21092bd04cc5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:33.190057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68d108-2962-403e-9dff-2864b13ee92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:33.190678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68d108-2962-403e-9dff-2864b13ee92d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:33.190968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68d108-2962-403e-9dff-2864b13ee92d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:33.191334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68d108-2962-403e-9dff-2864b13ee92d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:33.192074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68d108-2962-403e-9dff-2864b13ee92d None admin] RBAC: Adding query filter params (role.id=df79e12324de40afbb353b95363811cc, user.id=36baa4b9019e4d60b4be57fbe386b37c, scope.system=all) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:33.192392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68d108-2962-403e-9dff-2864b13ee92d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:33.193899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68d108-2962-403e-9dff-2864b13ee92d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:33.208065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 164/334] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Sep 9 11:58:33 2022] GET /identity/v3/role_assignments?user.id=36baa4b9019e4d60b4be57fbe386b37c&scope.system=all&role.id=df79e12324de40afbb353b95363811cc => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:34.600145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135916d9-cebf-44ac-8fef-ee1eaf139aa8 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:34.600660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135916d9-cebf-44ac-8fef-ee1eaf139aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:34.600660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135916d9-cebf-44ac-8fef-ee1eaf139aa8 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:34.602305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 171/335] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:34.609643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c82582-5f90-40af-b6dc-e00c8ee7f67f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:34.610120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c82582-5f90-40af-b6dc-e00c8ee7f67f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:34.610193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c82582-5f90-40af-b6dc-e00c8ee7f67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:34.640775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a4c82582-5f90-40af-b6dc-e00c8ee7f67f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:34.642049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a4c82582-5f90-40af-b6dc-e00c8ee7f67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:34.728473 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 165/336] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:35.285626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c68763-b48f-47aa-853a-22cec957c59a None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:35.286001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c68763-b48f-47aa-853a-22cec957c59a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:35.286202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c68763-b48f-47aa-853a-22cec957c59a None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:35.287800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 172/337] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:35.300932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c82582-5f90-40af-b6dc-e00c8ee7f67f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:35.301474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28221de9-3172-490c-bb64-c4e5e99eb227 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:35.301763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28221de9-3172-490c-bb64-c4e5e99eb227 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:35.302041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28221de9-3172-490c-bb64-c4e5e99eb227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:35.324158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-28221de9-3172-490c-bb64-c4e5e99eb227 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:35.325879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-28221de9-3172-490c-bb64-c4e5e99eb227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:35.449452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:35.462273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 173/338] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:35.478347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c82582-5f90-40af-b6dc-e00c8ee7f67f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:35.519927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cecd60-acfe-4c2c-9e36-89f6a5d7d143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:35.520579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cecd60-acfe-4c2c-9e36-89f6a5d7d143 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:35.520860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cecd60-acfe-4c2c-9e36-89f6a5d7d143 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:35.521131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cecd60-acfe-4c2c-9e36-89f6a5d7d143 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:35.540680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cecd60-acfe-4c2c-9e36-89f6a5d7d143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-e4cecd60-acfe-4c2c-9e36-89f6a5d7d143 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:35.545851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:35.546745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:35.548036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 166/339] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:35.556243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28221de9-3172-490c-bb64-c4e5e99eb227 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:35.624630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:35.697061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28221de9-3172-490c-bb64-c4e5e99eb227 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:35.735335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de9f10-958b-4aa5-a5fd-bfef018b31fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:35.735901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de9f10-958b-4aa5-a5fd-bfef018b31fd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:35.736181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de9f10-958b-4aa5-a5fd-bfef018b31fd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:35.736454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de9f10-958b-4aa5-a5fd-bfef018b31fd None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:35.737136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de9f10-958b-4aa5-a5fd-bfef018b31fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:35.737440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de9f10-958b-4aa5-a5fd-bfef018b31fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:35.738850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de9f10-958b-4aa5-a5fd-bfef018b31fd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:35.744743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065954c-0f5d-45c6-8b98-93b9264973fa None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:35.745641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065954c-0f5d-45c6-8b98-93b9264973fa None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:35.746120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065954c-0f5d-45c6-8b98-93b9264973fa None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:35.748811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 167/340] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:35.754118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 174/341] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:35.755465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a6e2b-ec3f-41ab-991f-1eec702a8dd7 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:35.755980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a6e2b-ec3f-41ab-991f-1eec702a8dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:35.756445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a6e2b-ec3f-41ab-991f-1eec702a8dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:35.760255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de9f10-958b-4aa5-a5fd-bfef018b31fd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:35.792381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-338a6e2b-ec3f-41ab-991f-1eec702a8dd7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:35.793598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-338a6e2b-ec3f-41ab-991f-1eec702a8dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:35.934628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 168/342] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:35.935897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a6e2b-ec3f-41ab-991f-1eec702a8dd7 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:35.959143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de9f10-958b-4aa5-a5fd-bfef018b31fd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:36.000613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:36.010316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef162a7-6f60-4507-b2bf-aad247fdaf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:36.010975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef162a7-6f60-4507-b2bf-aad247fdaf5c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:36.011689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef162a7-6f60-4507-b2bf-aad247fdaf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:36.011689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef162a7-6f60-4507-b2bf-aad247fdaf5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:36.024893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:36.068875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a6e2b-ec3f-41ab-991f-1eec702a8dd7 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:36.112584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef162a7-6f60-4507-b2bf-aad247fdaf5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:36.114511 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef162a7-6f60-4507-b2bf-aad247fdaf5c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:36.148368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ea5af-fdb1-4df9-a5a4-93e7a9fade36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:36.149019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ea5af-fdb1-4df9-a5a4-93e7a9fade36 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:36.149309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ea5af-fdb1-4df9-a5a4-93e7a9fade36 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:36.149581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ea5af-fdb1-4df9-a5a4-93e7a9fade36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:36.173797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ea5af-fdb1-4df9-a5a4-93e7a9fade36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-7a7ea5af-fdb1-4df9-a5a4-93e7a9fade36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:36.179164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:36.180531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:36.181309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 169/343] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:36.182411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5284d9-342b-4bfc-acc9-1582b54c1bba None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:36.182411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5284d9-342b-4bfc-acc9-1582b54c1bba None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:36.182696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5284d9-342b-4bfc-acc9-1582b54c1bba None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:36.186078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 170/344] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:36.192983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4d9f1-80bd-43a4-97ac-f3b18cc6af3b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:36.193245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4d9f1-80bd-43a4-97ac-f3b18cc6af3b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:36.193511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4d9f1-80bd-43a4-97ac-f3b18cc6af3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:36.224709 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-30f4d9f1-80bd-43a4-97ac-f3b18cc6af3b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:36.226450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-30f4d9f1-80bd-43a4-97ac-f3b18cc6af3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:36.245520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 175/345] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:36.246391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef162a7-6f60-4507-b2bf-aad247fdaf5c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:36.285297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:36.357567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 171/346] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:36.358243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4d9f1-80bd-43a4-97ac-f3b18cc6af3b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:36.412092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef162a7-6f60-4507-b2bf-aad247fdaf5c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:36.427463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:36.455975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17021e78-1273-4710-bbfb-14c6db7e28ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:36.456602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021e78-1273-4710-bbfb-14c6db7e28ea None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:36.456881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021e78-1273-4710-bbfb-14c6db7e28ea None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:36.457152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021e78-1273-4710-bbfb-14c6db7e28ea None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:36.457826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17021e78-1273-4710-bbfb-14c6db7e28ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:36.458128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17021e78-1273-4710-bbfb-14c6db7e28ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:36.459495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17021e78-1273-4710-bbfb-14c6db7e28ea None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:36.470282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 176/347] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:36.471110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17021e78-1273-4710-bbfb-14c6db7e28ea None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:36.471283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4d9f1-80bd-43a4-97ac-f3b18cc6af3b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:36.513673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d66e3-0728-43c2-a2d8-bc2df8be9d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:36.514317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d66e3-0728-43c2-a2d8-bc2df8be9d74 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:36.514579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d66e3-0728-43c2-a2d8-bc2df8be9d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:36.514851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d66e3-0728-43c2-a2d8-bc2df8be9d74 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:36.516219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d66e3-0728-43c2-a2d8-bc2df8be9d74 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:36.517837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d66e3-0728-43c2-a2d8-bc2df8be9d74 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:36.519832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 172/348] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:36 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:36.520704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d66e3-0728-43c2-a2d8-bc2df8be9d74 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:36.569066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:36.590422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17021e78-1273-4710-bbfb-14c6db7e28ea None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:36.635645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d694bf-17f2-4692-b40e-93e6cdb7baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:36.636382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d694bf-17f2-4692-b40e-93e6cdb7baec None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:36.636953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d694bf-17f2-4692-b40e-93e6cdb7baec None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:36.637411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d694bf-17f2-4692-b40e-93e6cdb7baec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:36.650794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d694bf-17f2-4692-b40e-93e6cdb7baec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-23d694bf-17f2-4692-b40e-93e6cdb7baec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:36.657188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:36.658300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:58:36.659346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:36.660064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d66e3-0728-43c2-a2d8-bc2df8be9d74 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:36.661018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 177/349] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:36.666570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d694bf-17f2-4692-b40e-93e6cdb7baec None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:36.704749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:36.712051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef261b-29a2-4984-9272-609b86b89caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:36.713727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef261b-29a2-4984-9272-609b86b89caf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:36.714201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef261b-29a2-4984-9272-609b86b89caf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:36.714617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef261b-29a2-4984-9272-609b86b89caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:36.801630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d694bf-17f2-4692-b40e-93e6cdb7baec None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:36.801863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef261b-29a2-4984-9272-609b86b89caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:36.803412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef261b-29a2-4984-9272-609b86b89caf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:36.848461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77012ac8-3aa8-4a4f-89ee-2df6a5ac20b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:36.849331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77012ac8-3aa8-4a4f-89ee-2df6a5ac20b9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:36.849964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77012ac8-3aa8-4a4f-89ee-2df6a5ac20b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:36.850386 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77012ac8-3aa8-4a4f-89ee-2df6a5ac20b9 None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:36.859439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77012ac8-3aa8-4a4f-89ee-2df6a5ac20b9 None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:36.861629 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77012ac8-3aa8-4a4f-89ee-2df6a5ac20b9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:36.864661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 178/350] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:36 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:36.865763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77012ac8-3aa8-4a4f-89ee-2df6a5ac20b9 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:36.872122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:36.932142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 173/351] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:36.933314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef261b-29a2-4984-9272-609b86b89caf None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:36.977494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:37.018264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77012ac8-3aa8-4a4f-89ee-2df6a5ac20b9 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:37.060730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef261b-29a2-4984-9272-609b86b89caf None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:37.076830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad4e17-0951-4529-b908-3abd1ed475ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:37.077972 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad4e17-0951-4529-b908-3abd1ed475ee None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.078406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad4e17-0951-4529-b908-3abd1ed475ee None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.078828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad4e17-0951-4529-b908-3abd1ed475ee None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.079701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad4e17-0951-4529-b908-3abd1ed475ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:37.080153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad4e17-0951-4529-b908-3abd1ed475ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:37.081655 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad4e17-0951-4529-b908-3abd1ed475ee None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:37.092237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 179/352] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:37.098087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad4e17-0951-4529-b908-3abd1ed475ee None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:37.108395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25559c30-425d-4a4c-9ced-4d58f93e6043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:37.109864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25559c30-425d-4a4c-9ced-4d58f93e6043 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.110307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25559c30-425d-4a4c-9ced-4d58f93e6043 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.110729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25559c30-425d-4a4c-9ced-4d58f93e6043 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.127351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25559c30-425d-4a4c-9ced-4d58f93e6043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-25559c30-425d-4a4c-9ced-4d58f93e6043 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:37.134926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:37.135835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:37.136624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 174/353] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:37.137277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25559c30-425d-4a4c-9ced-4d58f93e6043 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:37.182900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:37.235957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad4e17-0951-4529-b908-3abd1ed475ee None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:37.265977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:37.276086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25559c30-425d-4a4c-9ced-4d58f93e6043 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:37.287911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35321f2b-f00e-4d6c-8c40-b3ea5b1db91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:37.289465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35321f2b-f00e-4d6c-8c40-b3ea5b1db91c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.289992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35321f2b-f00e-4d6c-8c40-b3ea5b1db91c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.290462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35321f2b-f00e-4d6c-8c40-b3ea5b1db91c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.292090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35321f2b-f00e-4d6c-8c40-b3ea5b1db91c None admin] RBAC: Adding query filter params (group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role.id=df79e12324de40afbb353b95363811cc, scope.project.id=9078564600ac4355acf60302d36d426d) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:37.292633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35321f2b-f00e-4d6c-8c40-b3ea5b1db91c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:37.294342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35321f2b-f00e-4d6c-8c40-b3ea5b1db91c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:37.301528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 180/354] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:37 2022] GET /identity/v3/role_assignments?group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=df79e12324de40afbb353b95363811cc => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:37.303231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35321f2b-f00e-4d6c-8c40-b3ea5b1db91c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:37.325161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97837d6e-8d55-4e0c-98a3-1ed4e01b25fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:37.325832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97837d6e-8d55-4e0c-98a3-1ed4e01b25fa None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.326122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97837d6e-8d55-4e0c-98a3-1ed4e01b25fa None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.326389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97837d6e-8d55-4e0c-98a3-1ed4e01b25fa None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.328507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97837d6e-8d55-4e0c-98a3-1ed4e01b25fa None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:37.330573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97837d6e-8d55-4e0c-98a3-1ed4e01b25fa None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:37.332867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 175/355] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:37 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:37.334116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97837d6e-8d55-4e0c-98a3-1ed4e01b25fa None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:37.484452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35321f2b-f00e-4d6c-8c40-b3ea5b1db91c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:37.516704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97837d6e-8d55-4e0c-98a3-1ed4e01b25fa None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:37.528543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:37.534572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d942d46-b520-4d6d-a7a7-544e294478a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:37.535476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d942d46-b520-4d6d-a7a7-544e294478a7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.535784 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d942d46-b520-4d6d-a7a7-544e294478a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.536088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d942d46-b520-4d6d-a7a7-544e294478a7 None admin] PATH_INFO: `/v3/users/cb9001fb0cba477a8a3796cfcce79fa7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.537722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d942d46-b520-4d6d-a7a7-544e294478a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9001fb0cba477a8a3796cfcce79fa7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:37.539651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d942d46-b520-4d6d-a7a7-544e294478a7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:37.543858 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 181/356] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 11:58:37 2022] GET /identity/v3/users/cb9001fb0cba477a8a3796cfcce79fa7 => generated 293 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:37.547449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d942d46-b520-4d6d-a7a7-544e294478a7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:37.561399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a5074-a71e-4f3a-9a18-ab2b0606b86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:37.562187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a5074-a71e-4f3a-9a18-ab2b0606b86a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.562474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a5074-a71e-4f3a-9a18-ab2b0606b86a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.563182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a5074-a71e-4f3a-9a18-ab2b0606b86a None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.564615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a5074-a71e-4f3a-9a18-ab2b0606b86a None admin] RBAC: Adding query filter params (name=member) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:37.564931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a5074-a71e-4f3a-9a18-ab2b0606b86a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:37.566493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a5074-a71e-4f3a-9a18-ab2b0606b86a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:37.578392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 176/357] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:37.580067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71b28-8376-4f16-a161-9c5184a3c280 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.580357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71b28-8376-4f16-a161-9c5184a3c280 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.580636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71b28-8376-4f16-a161-9c5184a3c280 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.582716 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 177/358] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:37.583440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71b28-8376-4f16-a161-9c5184a3c280 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:37.619226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:37.683979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d942d46-b520-4d6d-a7a7-544e294478a7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:37.742815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f0542-9e0a-48c4-9bfb-b7877fd90be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:37.743885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f0542-9e0a-48c4-9bfb-b7877fd90be0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.744467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f0542-9e0a-48c4-9bfb-b7877fd90be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.744980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f0542-9e0a-48c4-9bfb-b7877fd90be0 None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.746335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f0542-9e0a-48c4-9bfb-b7877fd90be0 None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:37.748054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71b28-8376-4f16-a161-9c5184a3c280 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:37.749054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f0542-9e0a-48c4-9bfb-b7877fd90be0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:37.752435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 182/359] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:37 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:37.754108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093803f5-1f31-43ae-ba77-d51653631e43 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.754595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093803f5-1f31-43ae-ba77-d51653631e43 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.755104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093803f5-1f31-43ae-ba77-d51653631e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.776470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-093803f5-1f31-43ae-ba77-d51653631e43 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:37.778528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-093803f5-1f31-43ae-ba77-d51653631e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:37.794942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e250e-9e71-4982-9d7e-d42f14759ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:37.795608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e250e-9e71-4982-9d7e-d42f14759ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:37.795924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e250e-9e71-4982-9d7e-d42f14759ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:37.796202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e250e-9e71-4982-9d7e-d42f14759ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:37.797143 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e250e-9e71-4982-9d7e-d42f14759ed9 None admin] RBAC: Adding query filter params (role.id=accf76b1c5d94b02b8e0650939fab7f9, user.id=cb9001fb0cba477a8a3796cfcce79fa7, scope.system=all) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:37.797461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e250e-9e71-4982-9d7e-d42f14759ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:37.798963 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e250e-9e71-4982-9d7e-d42f14759ed9 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:37.812355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 178/360] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Sep 9 11:58:37 2022] GET /identity/v3/role_assignments?user.id=cb9001fb0cba477a8a3796cfcce79fa7&scope.system=all&role.id=accf76b1c5d94b02b8e0650939fab7f9 => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:37.813219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e250e-9e71-4982-9d7e-d42f14759ed9 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:37.866734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 183/361] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:37.867765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093803f5-1f31-43ae-ba77-d51653631e43 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:37.880013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:37.927710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:37.988956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e250e-9e71-4982-9d7e-d42f14759ed9 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:37.999598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093803f5-1f31-43ae-ba77-d51653631e43 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:38.050290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76500c7-3e39-4fd6-bd91-3baef1514ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:38.051428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76500c7-3e39-4fd6-bd91-3baef1514ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.052022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76500c7-3e39-4fd6-bd91-3baef1514ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.052831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76500c7-3e39-4fd6-bd91-3baef1514ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.054206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76500c7-3e39-4fd6-bd91-3baef1514ba4 None admin] RBAC: Adding query filter params (group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=9078564600ac4355acf60302d36d426d) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:38.054765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76500c7-3e39-4fd6-bd91-3baef1514ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:38.056451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76500c7-3e39-4fd6-bd91-3baef1514ba4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:38.057451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001775f-cab3-4e60-acee-12aea448fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:38.058069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001775f-cab3-4e60-acee-12aea448fac6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.058349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001775f-cab3-4e60-acee-12aea448fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.058620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001775f-cab3-4e60-acee-12aea448fac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.064821 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 184/362] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:37 2022] GET /identity/v3/role_assignments?group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=1387b2da4fc147fe99310c8bea8504be => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:38.067666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d16c-de2a-4c1f-b685-cff7710db924 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.067666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d16c-de2a-4c1f-b685-cff7710db924 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.067666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d16c-de2a-4c1f-b685-cff7710db924 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.070415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 185/363] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:38.081357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceca705-ff40-46d3-a8d4-045a69263e98 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.081688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceca705-ff40-46d3-a8d4-045a69263e98 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.081923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceca705-ff40-46d3-a8d4-045a69263e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.115982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8ceca705-ff40-46d3-a8d4-045a69263e98 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:38.117237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8ceca705-ff40-46d3-a8d4-045a69263e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:38.189797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001775f-cab3-4e60-acee-12aea448fac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:38.191693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001775f-cab3-4e60-acee-12aea448fac6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:38.218833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:38.238145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 186/364] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:38.307843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:38.310913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceca705-ff40-46d3-a8d4-045a69263e98 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:38.336550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 179/365] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:38.343141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001775f-cab3-4e60-acee-12aea448fac6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:38.503077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceca705-ff40-46d3-a8d4-045a69263e98 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:38.515021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001775f-cab3-4e60-acee-12aea448fac6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:38.560604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131078e3-8bc6-4d52-a02d-28630a06b2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:38.561168 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131078e3-8bc6-4d52-a02d-28630a06b2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.561450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131078e3-8bc6-4d52-a02d-28630a06b2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.561726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131078e3-8bc6-4d52-a02d-28630a06b2e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.575304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131078e3-8bc6-4d52-a02d-28630a06b2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-131078e3-8bc6-4d52-a02d-28630a06b2e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:38.582537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:38.583429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:38.584293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 187/366] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:38.593573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131078e3-8bc6-4d52-a02d-28630a06b2e1 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:38.594779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28435e-fe62-4e03-a675-defa47fdee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:38.595430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28435e-fe62-4e03-a675-defa47fdee14 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.595748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28435e-fe62-4e03-a675-defa47fdee14 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.596026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28435e-fe62-4e03-a675-defa47fdee14 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.597175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28435e-fe62-4e03-a675-defa47fdee14 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:38.598620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28435e-fe62-4e03-a675-defa47fdee14 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:38.600284 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 180/367] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:38 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:38.605920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28435e-fe62-4e03-a675-defa47fdee14 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:38.670131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:38.680388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:38.745511 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131078e3-8bc6-4d52-a02d-28630a06b2e1 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:38.755563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28435e-fe62-4e03-a675-defa47fdee14 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:38.797919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ee5a0-1012-4041-baf7-0224a3944483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:38.798963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ee5a0-1012-4041-baf7-0224a3944483 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.799466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ee5a0-1012-4041-baf7-0224a3944483 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.799893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ee5a0-1012-4041-baf7-0224a3944483 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.800374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550125b-608b-42a6-8e39-18808b462d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:38.800870 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ee5a0-1012-4041-baf7-0224a3944483 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:38.801270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ee5a0-1012-4041-baf7-0224a3944483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:38.801498 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550125b-608b-42a6-8e39-18808b462d31 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.801935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550125b-608b-42a6-8e39-18808b462d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.802344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550125b-608b-42a6-8e39-18808b462d31 None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.803410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ee5a0-1012-4041-baf7-0224a3944483 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:38.803828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550125b-608b-42a6-8e39-18808b462d31 None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:38.806081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550125b-608b-42a6-8e39-18808b462d31 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:38.809048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 181/368] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:38 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:38.809992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550125b-608b-42a6-8e39-18808b462d31 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:38.818545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 188/369] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:38.822095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ee5a0-1012-4041-baf7-0224a3944483 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:38.938142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550125b-608b-42a6-8e39-18808b462d31 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:38.950591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ee5a0-1012-4041-baf7-0224a3944483 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:38.958324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:38.966453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:38.981813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d5c16-594e-4a65-8a11-35e02a08c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:38.982876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d5c16-594e-4a65-8a11-35e02a08c287 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.983376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d5c16-594e-4a65-8a11-35e02a08c287 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.983875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d5c16-594e-4a65-8a11-35e02a08c287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.990153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610846e-ec71-47a4-8d38-23e21c431fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:38.990943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610846e-ec71-47a4-8d38-23e21c431fbb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:38.991385 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610846e-ec71-47a4-8d38-23e21c431fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:38.991787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610846e-ec71-47a4-8d38-23e21c431fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:38.992591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610846e-ec71-47a4-8d38-23e21c431fbb None admin] RBAC: Adding query filter params (group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role.id=df79e12324de40afbb353b95363811cc, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:38.993064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610846e-ec71-47a4-8d38-23e21c431fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:38.994488 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610846e-ec71-47a4-8d38-23e21c431fbb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:38.997224 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d5c16-594e-4a65-8a11-35e02a08c287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:39.001120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 189/370] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:38 2022] GET /identity/v3/role_assignments?group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=df79e12324de40afbb353b95363811cc => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:39.001960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610846e-ec71-47a4-8d38-23e21c431fbb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-ca0d5c16-594e-4a65-8a11-35e02a08c287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:39.003604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:39.004531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:39.005419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:39.008627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 182/371] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:58:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:39.014331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d5c16-594e-4a65-8a11-35e02a08c287 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:39.241830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d5c16-594e-4a65-8a11-35e02a08c287 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:39.249791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610846e-ec71-47a4-8d38-23e21c431fbb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:39.310682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a63b9-a3f4-446b-b30c-a65fa9a83994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:39.311279 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a63b9-a3f4-446b-b30c-a65fa9a83994 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:39.312021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a63b9-a3f4-446b-b30c-a65fa9a83994 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:39.312311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a63b9-a3f4-446b-b30c-a65fa9a83994 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:39.313138 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a63b9-a3f4-446b-b30c-a65fa9a83994 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:39.313587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a63b9-a3f4-446b-b30c-a65fa9a83994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:39.315127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a63b9-a3f4-446b-b30c-a65fa9a83994 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:39.320738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da5698-89ce-490a-ba36-638427ffaf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:39.321773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da5698-89ce-490a-ba36-638427ffaf05 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:39.322273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da5698-89ce-490a-ba36-638427ffaf05 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:39.322750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da5698-89ce-490a-ba36-638427ffaf05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:39.325466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 183/372] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:39.330692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a63b9-a3f4-446b-b30c-a65fa9a83994 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:39.414410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:39.421615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:39.491516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a63b9-a3f4-446b-b30c-a65fa9a83994 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:39.498146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da5698-89ce-490a-ba36-638427ffaf05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:39.499916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da5698-89ce-490a-ba36-638427ffaf05 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:39.546299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29416b-e9ec-467a-9103-5345834a08db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:39.546920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29416b-e9ec-467a-9103-5345834a08db None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:39.547205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29416b-e9ec-467a-9103-5345834a08db None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:39.547481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29416b-e9ec-467a-9103-5345834a08db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:39.621854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29416b-e9ec-467a-9103-5345834a08db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:39.623847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29416b-e9ec-467a-9103-5345834a08db None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:39.660255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 190/373] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:39.671575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:39.672989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da5698-89ce-490a-ba36-638427ffaf05 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:39.740974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 184/374] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:58:39.749161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29416b-e9ec-467a-9103-5345834a08db None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:39.807265 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:39.834688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da5698-89ce-490a-ba36-638427ffaf05 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:39.878710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8734d2d-a5eb-4bec-bc39-e53d0baa05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:39.879738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8734d2d-a5eb-4bec-bc39-e53d0baa05d5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:39.880223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8734d2d-a5eb-4bec-bc39-e53d0baa05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:39.880698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8734d2d-a5eb-4bec-bc39-e53d0baa05d5 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:39.882231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8734d2d-a5eb-4bec-bc39-e53d0baa05d5 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:39.883932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8734d2d-a5eb-4bec-bc39-e53d0baa05d5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:39.886137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 191/375] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:39 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:39.893679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29416b-e9ec-467a-9103-5345834a08db None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:39.897410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8734d2d-a5eb-4bec-bc39-e53d0baa05d5 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:39.941764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca097e-2d5c-48b6-a6d6-88f57fa416b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:39.942403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca097e-2d5c-48b6-a6d6-88f57fa416b7 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:39.942643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca097e-2d5c-48b6-a6d6-88f57fa416b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:39.942924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca097e-2d5c-48b6-a6d6-88f57fa416b7 None admin] PATH_INFO: `/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:39.944411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca097e-2d5c-48b6-a6d6-88f57fa416b7 None admin] RBAC: Authorizing `identity:get_project(project_id=a957b728ec1a4c5cb1b61c4acd7d2959)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:39.946577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca097e-2d5c-48b6-a6d6-88f57fa416b7 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:39.948524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 185/376] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:39 2022] GET /identity/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:39.956753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca097e-2d5c-48b6-a6d6-88f57fa416b7 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:39.967219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:40.048840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8734d2d-a5eb-4bec-bc39-e53d0baa05d5 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:40.068771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca097e-2d5c-48b6-a6d6-88f57fa416b7 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:40.094749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597587a-44c2-4f64-bdb5-bd33fb2c38cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:40.095399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597587a-44c2-4f64-bdb5-bd33fb2c38cc None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:40.095714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597587a-44c2-4f64-bdb5-bd33fb2c38cc None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:40.095986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597587a-44c2-4f64-bdb5-bd33fb2c38cc None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:40.097101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597587a-44c2-4f64-bdb5-bd33fb2c38cc None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:40.098544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597587a-44c2-4f64-bdb5-bd33fb2c38cc None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:40.101662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 192/377] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:39 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:40.102948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29735-4c0f-4ed1-8403-051bf8aebe34 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:40.103233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29735-4c0f-4ed1-8403-051bf8aebe34 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:40.103504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29735-4c0f-4ed1-8403-051bf8aebe34 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:40.105021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 193/378] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:40.105976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a84c1-2fa0-4b3c-b9a5-ab6f594524f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:40.106622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a84c1-2fa0-4b3c-b9a5-ab6f594524f8 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:40.106953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a84c1-2fa0-4b3c-b9a5-ab6f594524f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:40.107232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a84c1-2fa0-4b3c-b9a5-ab6f594524f8 None admin] PATH_INFO: `/v3/groups/f67e84e7cb9c4fcdb2c8e21274671f38` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:40.113429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcac2ac-83f5-4393-ac2d-1ba0c18a1cca None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:40.113695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcac2ac-83f5-4393-ac2d-1ba0c18a1cca None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:40.116614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcac2ac-83f5-4393-ac2d-1ba0c18a1cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:40.122690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a84c1-2fa0-4b3c-b9a5-ab6f594524f8 None admin] RBAC: Authorizing `identity:get_group(group_id=f67e84e7cb9c4fcdb2c8e21274671f38)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:40.122690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a84c1-2fa0-4b3c-b9a5-ab6f594524f8 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:40.124947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 186/379] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:39 2022] GET /identity/v3/groups/f67e84e7cb9c4fcdb2c8e21274671f38 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:40.125581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a84c1-2fa0-4b3c-b9a5-ab6f594524f8 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:40.144320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-bfcac2ac-83f5-4393-ac2d-1ba0c18a1cca None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:40.146008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bfcac2ac-83f5-4393-ac2d-1ba0c18a1cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:40.157121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:40.219058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:40.252766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 194/380] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:40.254616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcac2ac-83f5-4393-ac2d-1ba0c18a1cca None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:40.263610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a84c1-2fa0-4b3c-b9a5-ab6f594524f8 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:40.334130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1223e21-1ef3-4eed-ba23-9e74c8ec7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:40.336167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1223e21-1ef3-4eed-ba23-9e74c8ec7c63 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:40.336478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1223e21-1ef3-4eed-ba23-9e74c8ec7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:40.336758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1223e21-1ef3-4eed-ba23-9e74c8ec7c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:40.337511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1223e21-1ef3-4eed-ba23-9e74c8ec7c63 None admin] RBAC: Adding query filter params (group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:40.337829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1223e21-1ef3-4eed-ba23-9e74c8ec7c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:40.339286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1223e21-1ef3-4eed-ba23-9e74c8ec7c63 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:40.349567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 187/381] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:40 2022] GET /identity/v3/role_assignments?group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=1387b2da4fc147fe99310c8bea8504be => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:40.427947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcac2ac-83f5-4393-ac2d-1ba0c18a1cca None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:40.471161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5fffd-2bf7-4228-b02e-3fc069d95cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:40.471724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5fffd-2bf7-4228-b02e-3fc069d95cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:40.472005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5fffd-2bf7-4228-b02e-3fc069d95cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:40.472277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5fffd-2bf7-4228-b02e-3fc069d95cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:40.473014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5fffd-2bf7-4228-b02e-3fc069d95cb9 None admin] RBAC: Adding query filter params (group.id=f67e84e7cb9c4fcdb2c8e21274671f38, role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=a957b728ec1a4c5cb1b61c4acd7d2959) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:40.473324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5fffd-2bf7-4228-b02e-3fc069d95cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:40.474757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5fffd-2bf7-4228-b02e-3fc069d95cb9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:40.483314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 195/382] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:40 2022] GET /identity/v3/role_assignments?group.id=f67e84e7cb9c4fcdb2c8e21274671f38&scope.project.id=a957b728ec1a4c5cb1b61c4acd7d2959&role.id=06592016669243d99b430c46dd1c1d46 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:40.605664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1223e21-1ef3-4eed-ba23-9e74c8ec7c63 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:40.736075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1223e21-1ef3-4eed-ba23-9e74c8ec7c63 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:40.776150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689824c-07bd-4e1a-87a8-ad89d470075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:40.776807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689824c-07bd-4e1a-87a8-ad89d470075f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:40.777133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689824c-07bd-4e1a-87a8-ad89d470075f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:40.777410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689824c-07bd-4e1a-87a8-ad89d470075f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:40.779349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:40.789518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689824c-07bd-4e1a-87a8-ad89d470075f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4689824c-07bd-4e1a-87a8-ad89d470075f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:40.794501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:40.795376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:40.796220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 188/383] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:40.802267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5fffd-2bf7-4228-b02e-3fc069d95cb9 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:40.821632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:40.951330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5fffd-2bf7-4228-b02e-3fc069d95cb9 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:40.996010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f76c1-f6dd-4941-b3b8-9580bdb96373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:40.997011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f76c1-f6dd-4941-b3b8-9580bdb96373 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:40.997506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f76c1-f6dd-4941-b3b8-9580bdb96373 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:40.997989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f76c1-f6dd-4941-b3b8-9580bdb96373 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:40.999205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f76c1-f6dd-4941-b3b8-9580bdb96373 None admin] RBAC: Adding query filter params (name=member) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:40.999759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f76c1-f6dd-4941-b3b8-9580bdb96373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:41.001370 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f76c1-f6dd-4941-b3b8-9580bdb96373 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:41.011519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 196/384] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:41.017299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689824c-07bd-4e1a-87a8-ad89d470075f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:41.130091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3196c66-ab76-4dd9-a2f2-bd639f5d6288 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:41.130716 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3196c66-ab76-4dd9-a2f2-bd639f5d6288 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:41.131202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3196c66-ab76-4dd9-a2f2-bd639f5d6288 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:41.133649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 197/385] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:41.139863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d840e-983d-451f-8f5c-6fdb8c59988a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:41.140521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d840e-983d-451f-8f5c-6fdb8c59988a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:41.141007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d840e-983d-451f-8f5c-6fdb8c59988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:41.162256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d77d840e-983d-451f-8f5c-6fdb8c59988a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:41.164417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d77d840e-983d-451f-8f5c-6fdb8c59988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:41.189811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689824c-07bd-4e1a-87a8-ad89d470075f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:41.237655 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:41.244537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 198/386] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:41.265222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9da08-d635-4762-813e-5f0a6cbc717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:41.265222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9da08-d635-4762-813e-5f0a6cbc717a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:41.265222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9da08-d635-4762-813e-5f0a6cbc717a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:41.265222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9da08-d635-4762-813e-5f0a6cbc717a None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:41.265783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9da08-d635-4762-813e-5f0a6cbc717a None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:41.265783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9da08-d635-4762-813e-5f0a6cbc717a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:41.265783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 189/387] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:41 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:41.270078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d840e-983d-451f-8f5c-6fdb8c59988a None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:41.386397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d840e-983d-451f-8f5c-6fdb8c59988a None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:41.423179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db3de-2f36-4078-a0e3-da4a062aaa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:41.424429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db3de-2f36-4078-a0e3-da4a062aaa41 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:41.424915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db3de-2f36-4078-a0e3-da4a062aaa41 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:41.425390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db3de-2f36-4078-a0e3-da4a062aaa41 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:41.426777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7db3de-2f36-4078-a0e3-da4a062aaa41 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:41.428634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7db3de-2f36-4078-a0e3-da4a062aaa41 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:41.431512 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 199/388] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:41 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:41.437123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9da08-d635-4762-813e-5f0a6cbc717a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:41.515123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:41.567864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9da08-d635-4762-813e-5f0a6cbc717a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:41.613692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2311ae-800c-4d3a-92e0-a078ffc0de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:41.614786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2311ae-800c-4d3a-92e0-a078ffc0de76 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:41.615279 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2311ae-800c-4d3a-92e0-a078ffc0de76 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:41.615814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2311ae-800c-4d3a-92e0-a078ffc0de76 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:41.618024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2311ae-800c-4d3a-92e0-a078ffc0de76 None admin] RBAC: Authorizing `identity:create_grant(project_id=9078564600ac4355acf60302d36d426d, group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:41.619728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2311ae-800c-4d3a-92e0-a078ffc0de76 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:41.696357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 190/389] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 11:58:41 2022] PUT /identity/v3/projects/9078564600ac4355acf60302d36d426d/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:58:41.758066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db3de-2f36-4078-a0e3-da4a062aaa41 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:41.845398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:41.890676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db3de-2f36-4078-a0e3-da4a062aaa41 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:41.934248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fdcc7-a31e-425b-863d-c6e2d00d0df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:41.934938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdcc7-a31e-425b-863d-c6e2d00d0df7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:41.935228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdcc7-a31e-425b-863d-c6e2d00d0df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:41.935502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdcc7-a31e-425b-863d-c6e2d00d0df7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:41.947918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fdcc7-a31e-425b-863d-c6e2d00d0df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:41.949736 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0e86-8b19-459c-bef2-780c3c923f4a None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:41.950247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0e86-8b19-459c-bef2-780c3c923f4a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:41.950728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0e86-8b19-459c-bef2-780c3c923f4a None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:41.952255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 191/390] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-930fdcc7-a31e-425b-863d-c6e2d00d0df7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:41.955412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:41.956507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:41.957470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 200/391] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:41.960117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7dc3a-b1bd-4785-8c22-eb1cb712310c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:41.962535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7dc3a-b1bd-4785-8c22-eb1cb712310c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:41.962535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7dc3a-b1bd-4785-8c22-eb1cb712310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:41.964163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0e86-8b19-459c-bef2-780c3c923f4a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:41.980322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-0be7dc3a-b1bd-4785-8c22-eb1cb712310c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:41.981617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0be7dc3a-b1bd-4785-8c22-eb1cb712310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:42.082942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 201/392] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:42.130985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0e86-8b19-459c-bef2-780c3c923f4a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:42.161418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:42.175129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7ef41-bfee-4275-9d7b-f3323e56752e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:42.175781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7ef41-bfee-4275-9d7b-f3323e56752e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:42.176064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7ef41-bfee-4275-9d7b-f3323e56752e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:42.176339 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7ef41-bfee-4275-9d7b-f3323e56752e None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:42.177058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7ef41-bfee-4275-9d7b-f3323e56752e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:42.177370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7ef41-bfee-4275-9d7b-f3323e56752e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:42.178749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7ef41-bfee-4275-9d7b-f3323e56752e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:42.188075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 192/393] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:42.193529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7dc3a-b1bd-4785-8c22-eb1cb712310c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:42.266472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:42.324117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7dc3a-b1bd-4785-8c22-eb1cb712310c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:42.377379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da34aae-b9a0-4f41-a650-31aa887158b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:42.378427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da34aae-b9a0-4f41-a650-31aa887158b1 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:42.378916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da34aae-b9a0-4f41-a650-31aa887158b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:42.379401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da34aae-b9a0-4f41-a650-31aa887158b1 None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:42.380755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da34aae-b9a0-4f41-a650-31aa887158b1 None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:42.382962 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da34aae-b9a0-4f41-a650-31aa887158b1 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:42.384826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 202/394] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:42 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:42.390567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7ef41-bfee-4275-9d7b-f3323e56752e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:42.508881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da34aae-b9a0-4f41-a650-31aa887158b1 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:42.527400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7ef41-bfee-4275-9d7b-f3323e56752e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:42.572435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394732-bacc-425c-a420-4ea1038a5b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:42.578980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394732-bacc-425c-a420-4ea1038a5b93 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:42.579306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394732-bacc-425c-a420-4ea1038a5b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:42.579584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394732-bacc-425c-a420-4ea1038a5b93 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:42.580883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64394732-bacc-425c-a420-4ea1038a5b93 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:42.582324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64394732-bacc-425c-a420-4ea1038a5b93 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:42.584397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 193/395] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:42 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:42.597411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394732-bacc-425c-a420-4ea1038a5b93 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:42.692979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:42.721505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394732-bacc-425c-a420-4ea1038a5b93 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:42.746477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da34aae-b9a0-4f41-a650-31aa887158b1 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:42.761591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0ed89-3c9e-44a5-a446-67a242a6bd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:42.762274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0ed89-3c9e-44a5-a446-67a242a6bd89 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:42.762562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0ed89-3c9e-44a5-a446-67a242a6bd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:42.762843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0ed89-3c9e-44a5-a446-67a242a6bd89 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c/roles/1387b2da4fc147fe99310c8bea8504be` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:42.765082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0ed89-3c9e-44a5-a446-67a242a6bd89 None admin] RBAC: Authorizing `identity:create_grant(project_id=9078564600ac4355acf60302d36d426d, group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role_id=1387b2da4fc147fe99310c8bea8504be)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:42.767552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0ed89-3c9e-44a5-a446-67a242a6bd89 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:42.787271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:42.798871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b839c6-f993-4538-bda4-80b4ca329cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:42.799515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b839c6-f993-4538-bda4-80b4ca329cad None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:42.799825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b839c6-f993-4538-bda4-80b4ca329cad None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:42.800100 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b839c6-f993-4538-bda4-80b4ca329cad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:42.811841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b839c6-f993-4538-bda4-80b4ca329cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-c6b839c6-f993-4538-bda4-80b4ca329cad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:42.816958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:42.817919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:42.818735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 203/396] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:42.824607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b839c6-f993-4538-bda4-80b4ca329cad None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:42.849551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 194/397] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 11:58:42 2022] PUT /identity/v3/projects/9078564600ac4355acf60302d36d426d/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c/roles/1387b2da4fc147fe99310c8bea8504be => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:58:42.945705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b839c6-f993-4538-bda4-80b4ca329cad None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:42.982876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1802c-6431-4611-a025-eb1c2542b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:42.983500 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1802c-6431-4611-a025-eb1c2542b57d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:42.983841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1802c-6431-4611-a025-eb1c2542b57d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:42.984089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1802c-6431-4611-a025-eb1c2542b57d None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:42.984766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1802c-6431-4611-a025-eb1c2542b57d None admin] RBAC: Adding query filter params (name=member) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:42.985069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1802c-6431-4611-a025-eb1c2542b57d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:42.986525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1802c-6431-4611-a025-eb1c2542b57d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:42.996575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 204/398] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:43.002978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0ed89-3c9e-44a5-a446-67a242a6bd89 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:43.128652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0ed89-3c9e-44a5-a446-67a242a6bd89 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:43.150443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:43.176757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d2bb9-654e-4426-aa07-cbd05dec2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:43.177405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d2bb9-654e-4426-aa07-cbd05dec2aff None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:43.177685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d2bb9-654e-4426-aa07-cbd05dec2aff None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:43.177961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d2bb9-654e-4426-aa07-cbd05dec2aff None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:43.180378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d2bb9-654e-4426-aa07-cbd05dec2aff None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:43.181838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d2bb9-654e-4426-aa07-cbd05dec2aff None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:43.184281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 195/399] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:43 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:43.189818 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1802c-6431-4611-a025-eb1c2542b57d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:43.241124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:43.313120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1802c-6431-4611-a025-eb1c2542b57d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:43.357217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd9154-6f92-4a29-bb95-0a04da4df9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:43.357860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd9154-6f92-4a29-bb95-0a04da4df9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:43.358147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd9154-6f92-4a29-bb95-0a04da4df9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:43.358426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd9154-6f92-4a29-bb95-0a04da4df9e5 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:43.363051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd9154-6f92-4a29-bb95-0a04da4df9e5 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:43.364627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd9154-6f92-4a29-bb95-0a04da4df9e5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:43.366290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 205/400] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:43 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:43.376559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d2bb9-654e-4426-aa07-cbd05dec2aff None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:43.504923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d2bb9-654e-4426-aa07-cbd05dec2aff None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:43.551058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e877d93-7797-47e2-a69e-5e701598eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:43.551755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e877d93-7797-47e2-a69e-5e701598eba8 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:43.552042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e877d93-7797-47e2-a69e-5e701598eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:43.552319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e877d93-7797-47e2-a69e-5e701598eba8 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:43.554291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e877d93-7797-47e2-a69e-5e701598eba8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e03e1ea52d44839b4e066f2427b2e7, group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:43.556287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e877d93-7797-47e2-a69e-5e701598eba8 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:43.573605 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0914e-21e6-437a-a04e-82aca2b2aec9 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:43.573946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0914e-21e6-437a-a04e-82aca2b2aec9 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:43.574173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0914e-21e6-437a-a04e-82aca2b2aec9 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:43.575651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 206/401] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:43.581180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d4fb9-ebae-47d5-9838-a4858cf3d36c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:43.582004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d4fb9-ebae-47d5-9838-a4858cf3d36c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:43.582514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d4fb9-ebae-47d5-9838-a4858cf3d36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:43.605444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-091d4fb9-ebae-47d5-9838-a4858cf3d36c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:43.607184 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-091d4fb9-ebae-47d5-9838-a4858cf3d36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:43.667030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 196/402] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 11:58:43 2022] PUT /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:43.689586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 207/403] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:43.738228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79000d75-b5d9-4c12-a1da-783b9d0ea9c1 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:43.738587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79000d75-b5d9-4c12-a1da-783b9d0ea9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:43.738876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79000d75-b5d9-4c12-a1da-783b9d0ea9c1 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:43.740471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 197/404] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:43.746707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eef7e-4404-468b-99a5-2b075d669fb8 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:43.746998 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eef7e-4404-468b-99a5-2b075d669fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:43.747280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eef7e-4404-468b-99a5-2b075d669fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:43.781039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-bc4eef7e-4404-468b-99a5-2b075d669fb8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:43.782264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bc4eef7e-4404-468b-99a5-2b075d669fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:43.835253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:43.877325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 208/405] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:43.978158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79000d75-b5d9-4c12-a1da-783b9d0ea9c1 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:44.031859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:44.119093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79000d75-b5d9-4c12-a1da-783b9d0ea9c1 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:44.167061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff2155-d630-4a05-81d0-378fc621ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:44.167750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2155-d630-4a05-81d0-378fc621ba70 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:44.168014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2155-d630-4a05-81d0-378fc621ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:44.168286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2155-d630-4a05-81d0-378fc621ba70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:44.188546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff2155-d630-4a05-81d0-378fc621ba70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-19ff2155-d630-4a05-81d0-378fc621ba70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:44.193375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:44.194273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:44.195615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 198/406] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:44.202622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eef7e-4404-468b-99a5-2b075d669fb8 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:44.209007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff2155-d630-4a05-81d0-378fc621ba70 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:44.342132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eef7e-4404-468b-99a5-2b075d669fb8 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:44.384449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9094-d41c-4803-8b21-5a80483a4ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:44.385089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9094-d41c-4803-8b21-5a80483a4ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:44.385371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9094-d41c-4803-8b21-5a80483a4ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:44.385646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9094-d41c-4803-8b21-5a80483a4ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:44.386334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9094-d41c-4803-8b21-5a80483a4ba9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:44.386641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9094-d41c-4803-8b21-5a80483a4ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:44.388051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9094-d41c-4803-8b21-5a80483a4ba9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:44.397099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 209/407] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:44.403713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9094-d41c-4803-8b21-5a80483a4ba9 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:44.429309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:44.434156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff2155-d630-4a05-81d0-378fc621ba70 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:44.483091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:44.512674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf1b1-563c-41f7-94f8-c3fed05e45e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:44.513595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf1b1-563c-41f7-94f8-c3fed05e45e3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:44.515129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf1b1-563c-41f7-94f8-c3fed05e45e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:44.515588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf1b1-563c-41f7-94f8-c3fed05e45e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:44.535371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bf1b1-563c-41f7-94f8-c3fed05e45e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-a77bf1b1-563c-41f7-94f8-c3fed05e45e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:44.541704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:44.542800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:44.543684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:44.546611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 199/408] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:44.552489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf1b1-563c-41f7-94f8-c3fed05e45e3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:44.624885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9094-d41c-4803-8b21-5a80483a4ba9 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:44.666132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355bd21-1580-4eee-a30e-acc125d8e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:44.667664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355bd21-1580-4eee-a30e-acc125d8e26e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:44.668122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355bd21-1580-4eee-a30e-acc125d8e26e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:44.668789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355bd21-1580-4eee-a30e-acc125d8e26e None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:44.670055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355bd21-1580-4eee-a30e-acc125d8e26e None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:44.670597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf1b1-563c-41f7-94f8-c3fed05e45e3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:44.671842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355bd21-1580-4eee-a30e-acc125d8e26e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:44.675008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 210/409] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:44 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:44.681176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da7601-db35-43a6-b6ba-0552f894255f None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:44.682443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da7601-db35-43a6-b6ba-0552f894255f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:44.682876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da7601-db35-43a6-b6ba-0552f894255f None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:44.684894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 211/410] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:44.686248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da7601-db35-43a6-b6ba-0552f894255f None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:44.717293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e786cc6-6625-45ab-b851-622509bb7e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:44.718385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e786cc6-6625-45ab-b851-622509bb7e1e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:44.718975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e786cc6-6625-45ab-b851-622509bb7e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:44.719318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e786cc6-6625-45ab-b851-622509bb7e1e None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:44.720255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e786cc6-6625-45ab-b851-622509bb7e1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:44.720634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e786cc6-6625-45ab-b851-622509bb7e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:44.722718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e786cc6-6625-45ab-b851-622509bb7e1e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:44.738052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 200/411] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:44.739574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f4c2-8c68-47cb-beae-d6f46ea9ce5f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:44.739982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f4c2-8c68-47cb-beae-d6f46ea9ce5f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:44.740377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f4c2-8c68-47cb-beae-d6f46ea9ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:44.761174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d5f0f4c2-8c68-47cb-beae-d6f46ea9ce5f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:44.762402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d5f0f4c2-8c68-47cb-beae-d6f46ea9ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:44.784025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:44.800937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da7601-db35-43a6-b6ba-0552f894255f None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:44.804089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:44.841234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e29b4-f324-42a9-b82a-78fba9742616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:44.841869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e29b4-f324-42a9-b82a-78fba9742616 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:44.842148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e29b4-f324-42a9-b82a-78fba9742616 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:44.842420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e29b4-f324-42a9-b82a-78fba9742616 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:44.843557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e29b4-f324-42a9-b82a-78fba9742616 None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:44.845192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e29b4-f324-42a9-b82a-78fba9742616 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:44.847008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 212/412] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:44 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:44.847586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e29b4-f324-42a9-b82a-78fba9742616 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:44.862115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 201/413] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:44.863930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0f4c2-8c68-47cb-beae-d6f46ea9ce5f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:44.971742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e29b4-f324-42a9-b82a-78fba9742616 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:45.029412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0f4c2-8c68-47cb-beae-d6f46ea9ce5f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:45.035881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5ab52-085e-4975-92ff-3ade0ff22668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:45.036520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5ab52-085e-4975-92ff-3ade0ff22668 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:45.036798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5ab52-085e-4975-92ff-3ade0ff22668 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:45.037072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5ab52-085e-4975-92ff-3ade0ff22668 None admin] PATH_INFO: `/v3/groups/f67e84e7cb9c4fcdb2c8e21274671f38` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:45.041566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5ab52-085e-4975-92ff-3ade0ff22668 None admin] RBAC: Authorizing `identity:get_group(group_id=f67e84e7cb9c4fcdb2c8e21274671f38)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:45.043004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5ab52-085e-4975-92ff-3ade0ff22668 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:45.047522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 213/414] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:44 2022] GET /identity/v3/groups/f67e84e7cb9c4fcdb2c8e21274671f38 => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:45.054867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5ab52-085e-4975-92ff-3ade0ff22668 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:45.084925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f6edf-0f47-4be5-bb8f-4ba0572eb491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:45.086809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f6edf-0f47-4be5-bb8f-4ba0572eb491 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:45.087296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f6edf-0f47-4be5-bb8f-4ba0572eb491 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:45.087881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f6edf-0f47-4be5-bb8f-4ba0572eb491 None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c/roles/1387b2da4fc147fe99310c8bea8504be` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:45.097055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f6edf-0f47-4be5-bb8f-4ba0572eb491 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e03e1ea52d44839b4e066f2427b2e7, group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role_id=1387b2da4fc147fe99310c8bea8504be)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:45.098755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f6edf-0f47-4be5-bb8f-4ba0572eb491 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:45.120037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:45.181717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5ab52-085e-4975-92ff-3ade0ff22668 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:45.219021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692afa29-1a64-4ec7-9bcd-9e1e28b96a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:45.219726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692afa29-1a64-4ec7-9bcd-9e1e28b96a0b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:45.220013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692afa29-1a64-4ec7-9bcd-9e1e28b96a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:45.220238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692afa29-1a64-4ec7-9bcd-9e1e28b96a0b None admin] PATH_INFO: `/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:45.221380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692afa29-1a64-4ec7-9bcd-9e1e28b96a0b None admin] RBAC: Authorizing `identity:get_project(project_id=a957b728ec1a4c5cb1b61c4acd7d2959)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:45.222902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692afa29-1a64-4ec7-9bcd-9e1e28b96a0b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:45.224684 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 214/415] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:45 2022] GET /identity/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:45.232499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 202/416] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 11:58:44 2022] PUT /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c/roles/1387b2da4fc147fe99310c8bea8504be => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:45.233166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f6edf-0f47-4be5-bb8f-4ba0572eb491 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:45.233722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692afa29-1a64-4ec7-9bcd-9e1e28b96a0b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:45.267353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:45.361507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692afa29-1a64-4ec7-9bcd-9e1e28b96a0b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:45.372518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:45.417030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2c1a-e953-43aa-91fc-c967f8a97683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:45.417586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2c1a-e953-43aa-91fc-c967f8a97683 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:45.417869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2c1a-e953-43aa-91fc-c967f8a97683 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:45.418144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2c1a-e953-43aa-91fc-c967f8a97683 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:45.431261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2c1a-e953-43aa-91fc-c967f8a97683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-524e2c1a-e953-43aa-91fc-c967f8a97683 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:45.436183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:45.437098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:45.437900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 215/417] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:45.444967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2c1a-e953-43aa-91fc-c967f8a97683 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:45.469609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f6edf-0f47-4be5-bb8f-4ba0572eb491 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:45.521622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef546af-92ae-467d-b37b-ee1cb3c93c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:45.522369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef546af-92ae-467d-b37b-ee1cb3c93c19 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:45.522753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef546af-92ae-467d-b37b-ee1cb3c93c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:45.523174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef546af-92ae-467d-b37b-ee1cb3c93c19 None admin] PATH_INFO: `/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959/groups/f67e84e7cb9c4fcdb2c8e21274671f38/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:45.525385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef546af-92ae-467d-b37b-ee1cb3c93c19 None admin] RBAC: Authorizing `identity:create_grant(project_id=a957b728ec1a4c5cb1b61c4acd7d2959, group_id=f67e84e7cb9c4fcdb2c8e21274671f38, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:45.527006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef546af-92ae-467d-b37b-ee1cb3c93c19 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:45.588855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2c1a-e953-43aa-91fc-c967f8a97683 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:45.622411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 203/418] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 11:58:45 2022] PUT /identity/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959/groups/f67e84e7cb9c4fcdb2c8e21274671f38/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:45.631616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc930ad-065d-4c7d-b9eb-d8acc3ef6836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:45.633246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc930ad-065d-4c7d-b9eb-d8acc3ef6836 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:45.633694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc930ad-065d-4c7d-b9eb-d8acc3ef6836 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:45.634122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc930ad-065d-4c7d-b9eb-d8acc3ef6836 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:45.635017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc930ad-065d-4c7d-b9eb-d8acc3ef6836 None admin] RBAC: Adding query filter params (name=member) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:45.635512 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc930ad-065d-4c7d-b9eb-d8acc3ef6836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:45.637166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc930ad-065d-4c7d-b9eb-d8acc3ef6836 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:45.647894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 216/419] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:45.654037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef546af-92ae-467d-b37b-ee1cb3c93c19 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:45.754464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:45.789607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef546af-92ae-467d-b37b-ee1cb3c93c19 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:45.829550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8e1b-2d0c-4f4b-9204-76c6d6fd70e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:45.830341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8e1b-2d0c-4f4b-9204-76c6d6fd70e1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:45.830727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8e1b-2d0c-4f4b-9204-76c6d6fd70e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:45.831107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8e1b-2d0c-4f4b-9204-76c6d6fd70e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:45.909834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c8e1b-2d0c-4f4b-9204-76c6d6fd70e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:45.911461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c8e1b-2d0c-4f4b-9204-76c6d6fd70e1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:45.964376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da92d6-0a2a-47d0-8a1c-ae010d50cc29 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:45.964790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da92d6-0a2a-47d0-8a1c-ae010d50cc29 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:45.965208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da92d6-0a2a-47d0-8a1c-ae010d50cc29 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:45.967270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 217/420] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:45.972832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4206e0-8883-4842-a2ca-44338c3e8bae None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:45.973179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4206e0-8883-4842-a2ca-44338c3e8bae None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:45.973430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4206e0-8883-4842-a2ca-44338c3e8bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:46.000005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:46.000352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-7d4206e0-8883-4842-a2ca-44338c3e8bae None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:46.001735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7d4206e0-8883-4842-a2ca-44338c3e8bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:46.024841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 204/421] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:46.035291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:46.035424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8e1b-2d0c-4f4b-9204-76c6d6fd70e1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:46.079658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 218/422] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:46.177976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8e1b-2d0c-4f4b-9204-76c6d6fd70e1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:46.214738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f2f9-d7fe-46ca-afbb-deb056ca9116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:46.215388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f2f9-d7fe-46ca-afbb-deb056ca9116 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:46.215694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f2f9-d7fe-46ca-afbb-deb056ca9116 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:46.215980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f2f9-d7fe-46ca-afbb-deb056ca9116 None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:46.217111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f2f9-d7fe-46ca-afbb-deb056ca9116 None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:46.218572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f2f9-d7fe-46ca-afbb-deb056ca9116 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:46.220543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 205/423] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:46 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:46.226148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4206e0-8883-4842-a2ca-44338c3e8bae None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:46.360081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4206e0-8883-4842-a2ca-44338c3e8bae None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:46.365816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5741e4-2c8d-43c3-af70-a458474a58c3 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:46.366317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5741e4-2c8d-43c3-af70-a458474a58c3 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:46.366395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5741e4-2c8d-43c3-af70-a458474a58c3 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:46.367997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 206/424] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:46.373688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189da5d-c9f4-427f-ac29-a2ddd75cd035 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:46.374240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189da5d-c9f4-427f-ac29-a2ddd75cd035 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:46.374717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189da5d-c9f4-427f-ac29-a2ddd75cd035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:46.407850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-2189da5d-c9f4-427f-ac29-a2ddd75cd035 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:46.409383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2189da5d-c9f4-427f-ac29-a2ddd75cd035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:46.410423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291118f3-7f44-4459-abee-5119ac39e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:46.411127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291118f3-7f44-4459-abee-5119ac39e009 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:46.411419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291118f3-7f44-4459-abee-5119ac39e009 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:46.411720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291118f3-7f44-4459-abee-5119ac39e009 None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:46.412882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291118f3-7f44-4459-abee-5119ac39e009 None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:46.414359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291118f3-7f44-4459-abee-5119ac39e009 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:46.416281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 219/425] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:46 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:46.417057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291118f3-7f44-4459-abee-5119ac39e009 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:46.460656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:46.465411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:46.506728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 207/426] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:46.508170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189da5d-c9f4-427f-ac29-a2ddd75cd035 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:46.575921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291118f3-7f44-4459-abee-5119ac39e009 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:46.631043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c58246-c78d-4f7f-96f0-f042d99e1376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:46.631607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c58246-c78d-4f7f-96f0-f042d99e1376 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:46.631919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c58246-c78d-4f7f-96f0-f042d99e1376 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:46.632190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c58246-c78d-4f7f-96f0-f042d99e1376 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:46.645417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c58246-c78d-4f7f-96f0-f042d99e1376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-42c58246-c78d-4f7f-96f0-f042d99e1376 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:46.652006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:46.652863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:46.653651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 220/427] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:46.659141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c58246-c78d-4f7f-96f0-f042d99e1376 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:46.673608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189da5d-c9f4-427f-ac29-a2ddd75cd035 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:46.735482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974658-aa79-4e27-a594-901f2d27e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:46.736412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974658-aa79-4e27-a594-901f2d27e3bb None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:46.736831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974658-aa79-4e27-a594-901f2d27e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:46.737243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974658-aa79-4e27-a594-901f2d27e3bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:46.738106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974658-aa79-4e27-a594-901f2d27e3bb None admin] RBAC: Adding query filter params (group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role.id=df79e12324de40afbb353b95363811cc, scope.project.id=9078564600ac4355acf60302d36d426d) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:46.738571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974658-aa79-4e27-a594-901f2d27e3bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:46.740180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974658-aa79-4e27-a594-901f2d27e3bb None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:46.746726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 208/428] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:46 2022] GET /identity/v3/role_assignments?group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=df79e12324de40afbb353b95363811cc => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:46.798146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c58246-c78d-4f7f-96f0-f042d99e1376 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:46.808035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:46.836547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b61fa0-0a0a-4143-b6e3-ce2ca20d5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:46.837220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b61fa0-0a0a-4143-b6e3-ce2ca20d5f46 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:46.837506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b61fa0-0a0a-4143-b6e3-ce2ca20d5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:46.837780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b61fa0-0a0a-4143-b6e3-ce2ca20d5f46 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:46.838501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b61fa0-0a0a-4143-b6e3-ce2ca20d5f46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:46.838815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b61fa0-0a0a-4143-b6e3-ce2ca20d5f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:46.840599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b61fa0-0a0a-4143-b6e3-ce2ca20d5f46 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:46.850558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 221/429] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:46.856398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974658-aa79-4e27-a594-901f2d27e3bb None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:46.900133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:46.928558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b61fa0-0a0a-4143-b6e3-ce2ca20d5f46 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:46.988052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974658-aa79-4e27-a594-901f2d27e3bb None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:47.033186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f807e-b433-444d-bac4-6d2bf5ca5771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:47.033927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f807e-b433-444d-bac4-6d2bf5ca5771 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:47.034215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f807e-b433-444d-bac4-6d2bf5ca5771 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:47.034493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f807e-b433-444d-bac4-6d2bf5ca5771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:47.106031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b61fa0-0a0a-4143-b6e3-ce2ca20d5f46 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:47.118950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f807e-b433-444d-bac4-6d2bf5ca5771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:47.120448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f807e-b433-444d-bac4-6d2bf5ca5771 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:47.152415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae75b-c55d-4f45-bd3d-a433e580c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:47.153031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae75b-c55d-4f45-bd3d-a433e580c4ae None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:47.153317 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae75b-c55d-4f45-bd3d-a433e580c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:47.153596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae75b-c55d-4f45-bd3d-a433e580c4ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:47.166059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ae75b-c55d-4f45-bd3d-a433e580c4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-203ae75b-c55d-4f45-bd3d-a433e580c4ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:47.171614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:47.172519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:47.173340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 222/430] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:47.174546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:47.178662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae75b-c55d-4f45-bd3d-a433e580c4ae None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:47.192934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:47.255579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 209/431] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:47.258960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f807e-b433-444d-bac4-6d2bf5ca5771 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:47.326778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae75b-c55d-4f45-bd3d-a433e580c4ae None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:47.363206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4162-5047-47ae-bcb0-714bd1604e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:47.363923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4162-5047-47ae-bcb0-714bd1604e93 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:47.364208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4162-5047-47ae-bcb0-714bd1604e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:47.364487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4162-5047-47ae-bcb0-714bd1604e93 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:47.365165 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae4162-5047-47ae-bcb0-714bd1604e93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:47.365472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae4162-5047-47ae-bcb0-714bd1604e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:47.366907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae4162-5047-47ae-bcb0-714bd1604e93 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:47.378566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 223/432] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:58:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:47.384902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4162-5047-47ae-bcb0-714bd1604e93 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:47.387270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f807e-b433-444d-bac4-6d2bf5ca5771 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:47.425408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fca432-022a-4373-adbd-8ea6cc11635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:47.425974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fca432-022a-4373-adbd-8ea6cc11635c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:47.426255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fca432-022a-4373-adbd-8ea6cc11635c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:47.426526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fca432-022a-4373-adbd-8ea6cc11635c None admin] PATH_INFO: `/v3/projects/9078564600ac4355acf60302d36d426d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:47.427903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fca432-022a-4373-adbd-8ea6cc11635c None admin] RBAC: Authorizing `identity:get_project(project_id=9078564600ac4355acf60302d36d426d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:47.430070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fca432-022a-4373-adbd-8ea6cc11635c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:47.432114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 210/433] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:47 2022] GET /identity/v3/projects/9078564600ac4355acf60302d36d426d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:47.438957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fca432-022a-4373-adbd-8ea6cc11635c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:47.443594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:47.481270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:47.520669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4162-5047-47ae-bcb0-714bd1604e93 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:47.559658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292ea9-073e-4b98-95a4-a1a22423c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:47.560002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fca432-022a-4373-adbd-8ea6cc11635c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:47.560843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292ea9-073e-4b98-95a4-a1a22423c501 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:47.561338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292ea9-073e-4b98-95a4-a1a22423c501 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:47.561807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292ea9-073e-4b98-95a4-a1a22423c501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:47.603890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266deff-fd23-4b91-aa24-2aa6cb3dce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:47.606887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266deff-fd23-4b91-aa24-2aa6cb3dce47 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:47.607702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266deff-fd23-4b91-aa24-2aa6cb3dce47 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:47.608130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266deff-fd23-4b91-aa24-2aa6cb3dce47 None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:47.609895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266deff-fd23-4b91-aa24-2aa6cb3dce47 None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:47.613093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266deff-fd23-4b91-aa24-2aa6cb3dce47 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:47.616624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 211/434] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:47 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:47.624887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266deff-fd23-4b91-aa24-2aa6cb3dce47 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:47.650097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc292ea9-073e-4b98-95a4-a1a22423c501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:47.651941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc292ea9-073e-4b98-95a4-a1a22423c501 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:47.735573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:47.749168 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:47.773994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266deff-fd23-4b91-aa24-2aa6cb3dce47 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:47.784203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 224/435] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:47.790612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292ea9-073e-4b98-95a4-a1a22423c501 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:47.811075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d597df0-9453-4b3c-a582-732463a25104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:47.811900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d597df0-9453-4b3c-a582-732463a25104 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:47.812100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d597df0-9453-4b3c-a582-732463a25104 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:47.812374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d597df0-9453-4b3c-a582-732463a25104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:47.813094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d597df0-9453-4b3c-a582-732463a25104 None admin] RBAC: Adding query filter params (group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=9078564600ac4355acf60302d36d426d) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:47.813403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d597df0-9453-4b3c-a582-732463a25104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:47.814840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d597df0-9453-4b3c-a582-732463a25104 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:47.821790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 212/436] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:47 2022] GET /identity/v3/role_assignments?group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c&scope.project.id=9078564600ac4355acf60302d36d426d&role.id=1387b2da4fc147fe99310c8bea8504be => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:47.869907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4734d-17e2-451b-b766-028b2b77aa02 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:47.870360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4734d-17e2-451b-b766-028b2b77aa02 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:47.870726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4734d-17e2-451b-b766-028b2b77aa02 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:47.872697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 213/437] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:47.878848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162249d2-dec1-4c5c-827b-51d884e9e14b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:47.879198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162249d2-dec1-4c5c-827b-51d884e9e14b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:47.879546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162249d2-dec1-4c5c-827b-51d884e9e14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:47.902099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-162249d2-dec1-4c5c-827b-51d884e9e14b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:47.903558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-162249d2-dec1-4c5c-827b-51d884e9e14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:47.925433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292ea9-073e-4b98-95a4-a1a22423c501 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:48.015548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c292ae-aaca-418b-8a75-5746b5e312ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:48.016607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c292ae-aaca-418b-8a75-5746b5e312ca None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:48.016895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c292ae-aaca-418b-8a75-5746b5e312ca None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:48.017168 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c292ae-aaca-418b-8a75-5746b5e312ca None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:48.018400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c292ae-aaca-418b-8a75-5746b5e312ca None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:48.019988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c292ae-aaca-418b-8a75-5746b5e312ca None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:48.022235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 214/439] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:48.028652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 225/439] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:47 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:48.028822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162249d2-dec1-4c5c-827b-51d884e9e14b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:48.099026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:48.149902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162249d2-dec1-4c5c-827b-51d884e9e14b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:48.187402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecef8af-31a0-4fd2-aacb-d33943882ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:48.188484 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecef8af-31a0-4fd2-aacb-d33943882ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:48.188968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecef8af-31a0-4fd2-aacb-d33943882ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:48.189461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecef8af-31a0-4fd2-aacb-d33943882ac8 None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:48.190914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecef8af-31a0-4fd2-aacb-d33943882ac8 None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:48.192741 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecef8af-31a0-4fd2-aacb-d33943882ac8 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:48.194915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 215/440] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:48 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:48.201656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c292ae-aaca-418b-8a75-5746b5e312ca None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:48.250802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:48.306770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecef8af-31a0-4fd2-aacb-d33943882ac8 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:48.321890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c292ae-aaca-418b-8a75-5746b5e312ca None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:48.365679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b2ef2-1738-4ca6-8b29-899249c0c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:48.366337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b2ef2-1738-4ca6-8b29-899249c0c5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:48.367414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b2ef2-1738-4ca6-8b29-899249c0c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:48.367414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b2ef2-1738-4ca6-8b29-899249c0c5a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:48.368082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b2ef2-1738-4ca6-8b29-899249c0c5a8 None admin] RBAC: Adding query filter params (group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role.id=df79e12324de40afbb353b95363811cc, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:48.368485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b2ef2-1738-4ca6-8b29-899249c0c5a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:48.370049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b2ef2-1738-4ca6-8b29-899249c0c5a8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:48.376417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 226/441] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:48 2022] GET /identity/v3/role_assignments?group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=df79e12324de40afbb353b95363811cc => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:48.388768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de9a7-f657-4b73-bb67-f2f948332a54 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:48.389086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de9a7-f657-4b73-bb67-f2f948332a54 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:48.389331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de9a7-f657-4b73-bb67-f2f948332a54 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:48.390905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 227/442] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:48.396859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245a75b-08cb-4e52-8080-e9723f247757 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:48.397196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245a75b-08cb-4e52-8080-e9723f247757 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:48.397425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245a75b-08cb-4e52-8080-e9723f247757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:48.416866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9245a75b-08cb-4e52-8080-e9723f247757 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:48.418124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9245a75b-08cb-4e52-8080-e9723f247757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:48.422488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecef8af-31a0-4fd2-aacb-d33943882ac8 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:48.465655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:48.473317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913ec5-a1e9-4888-b3b5-00bfa304ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:48.473979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913ec5-a1e9-4888-b3b5-00bfa304ea2c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:48.474259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913ec5-a1e9-4888-b3b5-00bfa304ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:48.474544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913ec5-a1e9-4888-b3b5-00bfa304ea2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:48.486383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a913ec5-a1e9-4888-b3b5-00bfa304ea2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-1a913ec5-a1e9-4888-b3b5-00bfa304ea2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:48.491456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:48.493178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:48.494018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 216/443] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:48.499604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913ec5-a1e9-4888-b3b5-00bfa304ea2c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:48.503453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 228/444] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:48.620177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913ec5-a1e9-4888-b3b5-00bfa304ea2c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:48.656288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157a181-ed81-4f90-82f9-1d86a9d99913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:48.656900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a181-ed81-4f90-82f9-1d86a9d99913 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:48.657236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a181-ed81-4f90-82f9-1d86a9d99913 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:48.657457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a181-ed81-4f90-82f9-1d86a9d99913 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:48.658123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157a181-ed81-4f90-82f9-1d86a9d99913 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:48.658427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157a181-ed81-4f90-82f9-1d86a9d99913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:48.659870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157a181-ed81-4f90-82f9-1d86a9d99913 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:48.672251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 217/445] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:48.678096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245a75b-08cb-4e52-8080-e9723f247757 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:48.714130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:48.780660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157a181-ed81-4f90-82f9-1d86a9d99913 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:48.786748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245a75b-08cb-4e52-8080-e9723f247757 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:48.829039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4b502-8071-455e-bf89-8ace4c98a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:48.829662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4b502-8071-455e-bf89-8ace4c98a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:48.829979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4b502-8071-455e-bf89-8ace4c98a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:48.830333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4b502-8071-455e-bf89-8ace4c98a3e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:48.841703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:48.897133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157a181-ed81-4f90-82f9-1d86a9d99913 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:48.901358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4b502-8071-455e-bf89-8ace4c98a3e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:48.902833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4b502-8071-455e-bf89-8ace4c98a3e9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:48.932676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7466fa-bfb7-4cc3-b5b0-3a6d68868773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:48.933318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7466fa-bfb7-4cc3-b5b0-3a6d68868773 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:48.933599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7466fa-bfb7-4cc3-b5b0-3a6d68868773 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:48.933868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7466fa-bfb7-4cc3-b5b0-3a6d68868773 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:48.937290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:48.944854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7466fa-bfb7-4cc3-b5b0-3a6d68868773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-9c7466fa-bfb7-4cc3-b5b0-3a6d68868773 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:48.950150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:48.957163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:48.958154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 218/446] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:48.960186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7466fa-bfb7-4cc3-b5b0-3a6d68868773 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:49.007957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 229/447] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:49.014494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4b502-8071-455e-bf89-8ace4c98a3e9 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:49.061992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7466fa-bfb7-4cc3-b5b0-3a6d68868773 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:49.075371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:49.097853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11d573-4e51-41d4-8da7-3e138791bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:49.098601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11d573-4e51-41d4-8da7-3e138791bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:49.098878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11d573-4e51-41d4-8da7-3e138791bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:49.099148 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11d573-4e51-41d4-8da7-3e138791bdc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:49.099840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11d573-4e51-41d4-8da7-3e138791bdc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:49.100144 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11d573-4e51-41d4-8da7-3e138791bdc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:49.102119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11d573-4e51-41d4-8da7-3e138791bdc8 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:49.110629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 219/448] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:49.116892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11d573-4e51-41d4-8da7-3e138791bdc8 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:49.118450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4b502-8071-455e-bf89-8ace4c98a3e9 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:49.153126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24b255-57fb-4767-94f5-e8e410cc497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:49.153673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24b255-57fb-4767-94f5-e8e410cc497e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:49.153953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24b255-57fb-4767-94f5-e8e410cc497e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:49.154227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24b255-57fb-4767-94f5-e8e410cc497e None admin] PATH_INFO: `/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:49.155341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24b255-57fb-4767-94f5-e8e410cc497e None admin] RBAC: Authorizing `identity:get_project(project_id=f1e03e1ea52d44839b4e066f2427b2e7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:49.156820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24b255-57fb-4767-94f5-e8e410cc497e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:49.158420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 230/449] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:49 2022] GET /identity/v3/projects/f1e03e1ea52d44839b4e066f2427b2e7 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:49.164667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24b255-57fb-4767-94f5-e8e410cc497e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:49.167256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:49.221685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11d573-4e51-41d4-8da7-3e138791bdc8 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:49.255331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab895bcd-60e5-4348-9e71-1cef39f1973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:49.255959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab895bcd-60e5-4348-9e71-1cef39f1973d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:49.256238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab895bcd-60e5-4348-9e71-1cef39f1973d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:49.256517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab895bcd-60e5-4348-9e71-1cef39f1973d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:49.263334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24b255-57fb-4767-94f5-e8e410cc497e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:49.304221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1c238-6272-4767-82a9-db50cd7ce32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:49.305257 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:49.305488 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1c238-6272-4767-82a9-db50cd7ce32b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:49.305766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1c238-6272-4767-82a9-db50cd7ce32b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:49.306088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1c238-6272-4767-82a9-db50cd7ce32b None admin] PATH_INFO: `/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:49.307172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1c238-6272-4767-82a9-db50cd7ce32b None admin] RBAC: Authorizing `identity:get_group(group_id=b24aa41fc8ec47c2ac7ff0d297f52e9c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:49.308651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1c238-6272-4767-82a9-db50cd7ce32b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:49.310258 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 231/450] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:49 2022] GET /identity/v3/groups/b24aa41fc8ec47c2ac7ff0d297f52e9c => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:49.316402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1c238-6272-4767-82a9-db50cd7ce32b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:49.328202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab895bcd-60e5-4348-9e71-1cef39f1973d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:49.329652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab895bcd-60e5-4348-9e71-1cef39f1973d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:49.385396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:49.415131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1c238-6272-4767-82a9-db50cd7ce32b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:49.436124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 220/451] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:58:49.441834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab895bcd-60e5-4348-9e71-1cef39f1973d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:49.450710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298c7f3-47ba-4228-8aa9-f7137bc1a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:49.451326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298c7f3-47ba-4228-8aa9-f7137bc1a1da None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:49.451611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298c7f3-47ba-4228-8aa9-f7137bc1a1da None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:49.451951 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298c7f3-47ba-4228-8aa9-f7137bc1a1da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:49.454372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298c7f3-47ba-4228-8aa9-f7137bc1a1da None admin] RBAC: Adding query filter params (group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c, role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:49.454372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298c7f3-47ba-4228-8aa9-f7137bc1a1da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:49.454372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298c7f3-47ba-4228-8aa9-f7137bc1a1da None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:49.460415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 232/452] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:49 2022] GET /identity/v3/role_assignments?group.id=b24aa41fc8ec47c2ac7ff0d297f52e9c&scope.project.id=f1e03e1ea52d44839b4e066f2427b2e7&role.id=1387b2da4fc147fe99310c8bea8504be => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:49.524469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:49.547692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab895bcd-60e5-4348-9e71-1cef39f1973d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:49.584345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84421aa-6e66-446a-a03b-6c8e45d3a7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:49.584990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84421aa-6e66-446a-a03b-6c8e45d3a7bb None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:49.585274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84421aa-6e66-446a-a03b-6c8e45d3a7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:49.585544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84421aa-6e66-446a-a03b-6c8e45d3a7bb None admin] PATH_INFO: `/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:49.587499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84421aa-6e66-446a-a03b-6c8e45d3a7bb None admin] RBAC: Authorizing `identity:get_project(project_id=a957b728ec1a4c5cb1b61c4acd7d2959)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:49.589016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84421aa-6e66-446a-a03b-6c8e45d3a7bb None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:49.590705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 221/453] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 11:58:49 2022] GET /identity/v3/projects/a957b728ec1a4c5cb1b61c4acd7d2959 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:49.596342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298c7f3-47ba-4228-8aa9-f7137bc1a1da None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:49.701545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298c7f3-47ba-4228-8aa9-f7137bc1a1da None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:49.735463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dda934-9284-406c-b12e-5151d151de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:49.736301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dda934-9284-406c-b12e-5151d151de80 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:49.736467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dda934-9284-406c-b12e-5151d151de80 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:49.736746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dda934-9284-406c-b12e-5151d151de80 None admin] PATH_INFO: `/v3/groups/f67e84e7cb9c4fcdb2c8e21274671f38` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:49.737857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dda934-9284-406c-b12e-5151d151de80 None admin] RBAC: Authorizing `identity:get_group(group_id=f67e84e7cb9c4fcdb2c8e21274671f38)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:49.739291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dda934-9284-406c-b12e-5151d151de80 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:49.740888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 233/454] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 11:58:49 2022] GET /identity/v3/groups/f67e84e7cb9c4fcdb2c8e21274671f38 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:49.746944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84421aa-6e66-446a-a03b-6c8e45d3a7bb None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:49.851962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84421aa-6e66-446a-a03b-6c8e45d3a7bb None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:49.886471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2370d6-33d3-428f-b512-671fabf56bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:49.887065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2370d6-33d3-428f-b512-671fabf56bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:49.887341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2370d6-33d3-428f-b512-671fabf56bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:49.887611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2370d6-33d3-428f-b512-671fabf56bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:49.888420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2370d6-33d3-428f-b512-671fabf56bd6 None admin] RBAC: Adding query filter params (group.id=f67e84e7cb9c4fcdb2c8e21274671f38, role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=a957b728ec1a4c5cb1b61c4acd7d2959) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:49.888752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2370d6-33d3-428f-b512-671fabf56bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:49.890176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2370d6-33d3-428f-b512-671fabf56bd6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:49.895831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 222/455] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 11:58:49 2022] GET /identity/v3/role_assignments?group.id=f67e84e7cb9c4fcdb2c8e21274671f38&scope.project.id=a957b728ec1a4c5cb1b61c4acd7d2959&role.id=06592016669243d99b430c46dd1c1d46 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:52.501089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdbd90-c052-44e7-9f3a-2772b5e3a672 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:52.501582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdbd90-c052-44e7-9f3a-2772b5e3a672 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:52.501582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdbd90-c052-44e7-9f3a-2772b5e3a672 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:52.503141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 234/456] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:52.509403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e53ee-8c96-4305-98db-da46325c5186 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:52.509923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e53ee-8c96-4305-98db-da46325c5186 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:52.510011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e53ee-8c96-4305-98db-da46325c5186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:52.537677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-317e53ee-8c96-4305-98db-da46325c5186 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:52.538940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-317e53ee-8c96-4305-98db-da46325c5186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:52.541279 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:52.622223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 223/457] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:52.706532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4603a-0442-417b-83d3-6d82a66db61a None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:52.706866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4603a-0442-417b-83d3-6d82a66db61a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:52.707090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4603a-0442-417b-83d3-6d82a66db61a None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:52.708738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 235/458] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:52.721175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945a3d-f818-4c83-b0f8-d507735811d8 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:52.721454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945a3d-f818-4c83-b0f8-d507735811d8 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:52.721726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945a3d-f818-4c83-b0f8-d507735811d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:52.745025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-30945a3d-f818-4c83-b0f8-d507735811d8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:52.746220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-30945a3d-f818-4c83-b0f8-d507735811d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:52.824770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 224/459] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:52.933556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4603a-0442-417b-83d3-6d82a66db61a None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:52.936678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:53.048472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4603a-0442-417b-83d3-6d82a66db61a None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:53.099122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4661-1154-4507-9da1-26e33b394e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:53.099754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4661-1154-4507-9da1-26e33b394e3a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.100038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4661-1154-4507-9da1-26e33b394e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.100313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4661-1154-4507-9da1-26e33b394e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.113633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa4661-1154-4507-9da1-26e33b394e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:53.115101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa4661-1154-4507-9da1-26e33b394e3a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-32aa4661-1154-4507-9da1-26e33b394e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:53.132309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:53.133856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:53.134709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:53.134709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:53.134709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:53.134709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 236/460] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:53.137854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f688c8-18da-4e62-ba24-a5d63cd61b22 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.138414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f688c8-18da-4e62-ba24-a5d63cd61b22 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.138905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f688c8-18da-4e62-ba24-a5d63cd61b22 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.144591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4661-1154-4507-9da1-26e33b394e3a None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:53.144961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 225/461] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:53.146596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ace4a-66c8-458a-8fdb-e2239abb2322 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.147079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ace4a-66c8-458a-8fdb-e2239abb2322 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.147549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ace4a-66c8-458a-8fdb-e2239abb2322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.166801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ec6ace4a-66c8-458a-8fdb-e2239abb2322 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:53.168477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ec6ace4a-66c8-458a-8fdb-e2239abb2322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:53.238685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:53.249829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 226/462] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:53.250628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ace4a-66c8-458a-8fdb-e2239abb2322 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:53.266918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:53.345704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4661-1154-4507-9da1-26e33b394e3a None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:53.420889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1af4e5-1c8d-4cdc-b388-676f5a34f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:53.421434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1af4e5-1c8d-4cdc-b388-676f5a34f26d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.421708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1af4e5-1c8d-4cdc-b388-676f5a34f26d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.422046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1af4e5-1c8d-4cdc-b388-676f5a34f26d None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.422703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1af4e5-1c8d-4cdc-b388-676f5a34f26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:53.423052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1af4e5-1c8d-4cdc-b388-676f5a34f26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:53.424475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1af4e5-1c8d-4cdc-b388-676f5a34f26d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:53.448172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ace4a-66c8-458a-8fdb-e2239abb2322 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:53.452057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 237/463] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:58:53.461189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1af4e5-1c8d-4cdc-b388-676f5a34f26d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:53.507653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94f515-74a3-4754-b792-7ee929761ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:53.508329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94f515-74a3-4754-b792-7ee929761ece None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.508612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94f515-74a3-4754-b792-7ee929761ece None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.508888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94f515-74a3-4754-b792-7ee929761ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.520644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94f515-74a3-4754-b792-7ee929761ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:53.522131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94f515-74a3-4754-b792-7ee929761ece None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-7c94f515-74a3-4754-b792-7ee929761ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:53.540034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:53.540978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:53.541807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:53.541807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:53.541807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:53.541807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 227/464] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:53.542439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878302c4-321a-4e00-94c4-63bb8676c03b None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.542605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878302c4-321a-4e00-94c4-63bb8676c03b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.542863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878302c4-321a-4e00-94c4-63bb8676c03b None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.549048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 228/465] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:53.553699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878302c4-321a-4e00-94c4-63bb8676c03b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:53.607518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1af4e5-1c8d-4cdc-b388-676f5a34f26d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:53.615126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:53.623812 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:53.644526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98dedb-49c4-4180-9d44-409fd7a70050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:53.645140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98dedb-49c4-4180-9d44-409fd7a70050 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.645420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98dedb-49c4-4180-9d44-409fd7a70050 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.645698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98dedb-49c4-4180-9d44-409fd7a70050 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.646349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98dedb-49c4-4180-9d44-409fd7a70050 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:53.648002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98dedb-49c4-4180-9d44-409fd7a70050 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:53.669259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878302c4-321a-4e00-94c4-63bb8676c03b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:53.702803 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05848dca-6cd4-4fb5-b6e1-e9410727235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:53.703326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05848dca-6cd4-4fb5-b6e1-e9410727235f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.703606 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05848dca-6cd4-4fb5-b6e1-e9410727235f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.703913 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05848dca-6cd4-4fb5-b6e1-e9410727235f None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.704602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05848dca-6cd4-4fb5-b6e1-e9410727235f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:53.704910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05848dca-6cd4-4fb5-b6e1-e9410727235f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:53.706279 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05848dca-6cd4-4fb5-b6e1-e9410727235f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:53.725231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 229/466] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:53.727120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deae96-6d3d-46ef-b6d4-2c2fe5f79040 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.727409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deae96-6d3d-46ef-b6d4-2c2fe5f79040 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.727715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deae96-6d3d-46ef-b6d4-2c2fe5f79040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.745885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-23deae96-6d3d-46ef-b6d4-2c2fe5f79040 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:53.747206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-23deae96-6d3d-46ef-b6d4-2c2fe5f79040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:53.755013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 238/467] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:58:53 2022] POST /identity/v3/users => generated 246 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:58:53.755947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98dedb-49c4-4180-9d44-409fd7a70050 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:53.863795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 230/468] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:53.864768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deae96-6d3d-46ef-b6d4-2c2fe5f79040 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:53.906110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98dedb-49c4-4180-9d44-409fd7a70050 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:53.952945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:53.964273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff925613-f15c-4bd5-a2df-8b1e6c81edb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:53.964918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff925613-f15c-4bd5-a2df-8b1e6c81edb5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:53.965203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff925613-f15c-4bd5-a2df-8b1e6c81edb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:53.965475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff925613-f15c-4bd5-a2df-8b1e6c81edb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:53.976982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff925613-f15c-4bd5-a2df-8b1e6c81edb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:53.978525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff925613-f15c-4bd5-a2df-8b1e6c81edb5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-ff925613-f15c-4bd5-a2df-8b1e6c81edb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:53.994107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:53.995072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:53.995976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:53.995976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:53.995976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:54.000560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 239/469] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:54.003397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff925613-f15c-4bd5-a2df-8b1e6c81edb5 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:54.034181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:54.045481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deae96-6d3d-46ef-b6d4-2c2fe5f79040 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:54.086435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97f25-1114-4d76-93a5-8833163c5f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:54.087397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97f25-1114-4d76-93a5-8833163c5f3c None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:54.087968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97f25-1114-4d76-93a5-8833163c5f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:54.088467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97f25-1114-4d76-93a5-8833163c5f3c None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:54.089318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a97f25-1114-4d76-93a5-8833163c5f3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:54.090956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a97f25-1114-4d76-93a5-8833163c5f3c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:54.120149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff925613-f15c-4bd5-a2df-8b1e6c81edb5 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:54.165737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 231/470] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:58:53 2022] POST /identity/v3/users => generated 248 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:54.169905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5da8d-fabc-4c1d-94cf-7c49ab8e2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:54.170530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5da8d-fabc-4c1d-94cf-7c49ab8e2548 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:54.170810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5da8d-fabc-4c1d-94cf-7c49ab8e2548 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:54.171092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5da8d-fabc-4c1d-94cf-7c49ab8e2548 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:54.172294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5da8d-fabc-4c1d-94cf-7c49ab8e2548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:54.172294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5da8d-fabc-4c1d-94cf-7c49ab8e2548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:54.173503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5da8d-fabc-4c1d-94cf-7c49ab8e2548 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:54.184992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97f25-1114-4d76-93a5-8833163c5f3c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:54.188073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 240/471] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:54.195896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5da8d-fabc-4c1d-94cf-7c49ab8e2548 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:54.312746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:54.332583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:54.339099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97f25-1114-4d76-93a5-8833163c5f3c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:54.339657 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5da8d-fabc-4c1d-94cf-7c49ab8e2548 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:54.390882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590cd12-7f67-4acf-b12c-861b1c710a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:54.391461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590cd12-7f67-4acf-b12c-861b1c710a7c None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:54.391648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad61ce-3f32-4186-82b3-5b7ec88d76a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:54.391932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590cd12-7f67-4acf-b12c-861b1c710a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:54.392091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590cd12-7f67-4acf-b12c-861b1c710a7c None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:54.392270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad61ce-3f32-4186-82b3-5b7ec88d76a5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:54.392555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad61ce-3f32-4186-82b3-5b7ec88d76a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:54.392734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590cd12-7f67-4acf-b12c-861b1c710a7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:54.392831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad61ce-3f32-4186-82b3-5b7ec88d76a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:54.394169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590cd12-7f67-4acf-b12c-861b1c710a7c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:54.404881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad61ce-3f32-4186-82b3-5b7ec88d76a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:54.406404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad61ce-3f32-4186-82b3-5b7ec88d76a5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-7dad61ce-3f32-4186-82b3-5b7ec88d76a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:54.424468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:54.425460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:54.426377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:54.426377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:54.426377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:54.426377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 232/472] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:54.426823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ab909-fb05-472e-a812-5eee7bdcf222 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:54.427120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ab909-fb05-472e-a812-5eee7bdcf222 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:54.427407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ab909-fb05-472e-a812-5eee7bdcf222 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:54.430198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 233/473] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:54.435415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ab909-fb05-472e-a812-5eee7bdcf222 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:54.495817 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 241/474] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:58:54 2022] POST /identity/v3/users => generated 248 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:54.497754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a1914-a35e-442d-a7c7-1565814c16dd None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:54.498325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a1914-a35e-442d-a7c7-1565814c16dd None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:54.498877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a1914-a35e-442d-a7c7-1565814c16dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:54.521564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5b4a1914-a35e-442d-a7c7-1565814c16dd None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:54.523066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5b4a1914-a35e-442d-a7c7-1565814c16dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:54.612810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ab909-fb05-472e-a812-5eee7bdcf222 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:54.651858 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 242/475] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:54.685336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5621a-e4b4-433e-a8d8-6cf90c51af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:54.686045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5621a-e4b4-433e-a8d8-6cf90c51af06 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:54.686334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5621a-e4b4-433e-a8d8-6cf90c51af06 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:54.686610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5621a-e4b4-433e-a8d8-6cf90c51af06 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:54.687284 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5621a-e4b4-433e-a8d8-6cf90c51af06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:54.687594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5621a-e4b4-433e-a8d8-6cf90c51af06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:54.689052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5621a-e4b4-433e-a8d8-6cf90c51af06 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:54.702761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 234/476] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:54.708107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a1914-a35e-442d-a7c7-1565814c16dd None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:54.789525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:54.842422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a1914-a35e-442d-a7c7-1565814c16dd None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:54.881205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd5080-267c-4324-8982-5d54eee182b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:54.881730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd5080-267c-4324-8982-5d54eee182b3 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:54.882006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd5080-267c-4324-8982-5d54eee182b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:54.882272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd5080-267c-4324-8982-5d54eee182b3 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:54.882963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd5080-267c-4324-8982-5d54eee182b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:54.884454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd5080-267c-4324-8982-5d54eee182b3 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:54.967852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5621a-e4b4-433e-a8d8-6cf90c51af06 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:54.979751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:55.002287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 243/477] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:58:54 2022] POST /identity/v3/users => generated 249 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:55.103299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5621a-e4b4-433e-a8d8-6cf90c51af06 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:55.161732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:55.162409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:55.162691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:55.162961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:55.163720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:55.165147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:55.209556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.sql.core [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 11:58:55.209556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 11:58:55.209556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [parameters: {'id': '7cd1b1f070c34584807ab81ea0c173e9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 11:58:55.209556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81773) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application result.read() Sep 09 11:58:55.225374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return ref.to_dict() Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:58:55.226307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application yield resource Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise self.value Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application session.commit() Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:58:55.227343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:58:55.228239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:58:55.229139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application result.read() Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:58:55.229971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [parameters: {'id': '7cd1b1f070c34584807ab81ea0c173e9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:55.230756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 11:58:55.231543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:55.234805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 235/478] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 11:58:54 2022] POST /identity/v3/roles => generated 144 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:55.234943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd5080-267c-4324-8982-5d54eee182b3 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:55.384900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd5080-267c-4324-8982-5d54eee182b3 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:55.408834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:55.423101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372214-a0bb-4c04-85d2-af9e479b533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:55.423699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372214-a0bb-4c04-85d2-af9e479b533d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:55.424043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372214-a0bb-4c04-85d2-af9e479b533d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:55.424319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372214-a0bb-4c04-85d2-af9e479b533d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:55.438586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98372214-a0bb-4c04-85d2-af9e479b533d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-98372214-a0bb-4c04-85d2-af9e479b533d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:55.443780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:55.449696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:55.451768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 244/479] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:58:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:55.459659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:55.555475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:55.587952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6703c-5b3e-40dd-80a5-5593ca4a57df None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:55.623379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b8068-be3e-4675-a208-1d1ba7ca4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:55.624461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b8068-be3e-4675-a208-1d1ba7ca4c3a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:55.624628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b8068-be3e-4675-a208-1d1ba7ca4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:55.624804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b8068-be3e-4675-a208-1d1ba7ca4c3a None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:55.625514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b8068-be3e-4675-a208-1d1ba7ca4c3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:55.626047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b8068-be3e-4675-a208-1d1ba7ca4c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:55.627873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b8068-be3e-4675-a208-1d1ba7ca4c3a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:55.642005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 236/480] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:58:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:56.454284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57e3d-306f-4ba1-9e1c-9ee1f1c426ec None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:56.454960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57e3d-306f-4ba1-9e1c-9ee1f1c426ec None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:56.454960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57e3d-306f-4ba1-9e1c-9ee1f1c426ec None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:56.456387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 245/481] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:56.462356 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57302d-4fdb-4353-a587-00f989c12793 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:56.462643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57302d-4fdb-4353-a587-00f989c12793 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:56.462919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57302d-4fdb-4353-a587-00f989c12793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:56.492726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-3c57302d-4fdb-4353-a587-00f989c12793 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:56.493940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3c57302d-4fdb-4353-a587-00f989c12793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:56.587999 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 237/482] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:56.899006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183221b-b437-4ccd-8a0a-96a481341a23 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:56.899382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183221b-b437-4ccd-8a0a-96a481341a23 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:56.899612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183221b-b437-4ccd-8a0a-96a481341a23 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:56.901199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 246/483] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:56.906805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e5c8e-1944-48e6-a3c9-ccf4bd86f152 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:56.907276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e5c8e-1944-48e6-a3c9-ccf4bd86f152 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:56.907350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e5c8e-1944-48e6-a3c9-ccf4bd86f152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:56.931229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-c99e5c8e-1944-48e6-a3c9-ccf4bd86f152 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:56.936938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c99e5c8e-1944-48e6-a3c9-ccf4bd86f152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:57.013523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:57.021923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 238/484] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:57.055371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183221b-b437-4ccd-8a0a-96a481341a23 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:57.215357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183221b-b437-4ccd-8a0a-96a481341a23 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:57.261748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7acf-f0aa-4d89-a0ae-a48f1b7338b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:57.262394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7acf-f0aa-4d89-a0ae-a48f1b7338b4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:57.262677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7acf-f0aa-4d89-a0ae-a48f1b7338b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:57.262952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7acf-f0aa-4d89-a0ae-a48f1b7338b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:57.277981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f7acf-f0aa-4d89-a0ae-a48f1b7338b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-d26f7acf-f0aa-4d89-a0ae-a48f1b7338b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:57.283244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:57.284179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:58:57.284975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:57.287731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 247/485] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:58:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:57.290133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e5c8e-1944-48e6-a3c9-ccf4bd86f152 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:57.304384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbcfe-6be8-4351-8896-83b599b8c463 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:57.305224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbcfe-6be8-4351-8896-83b599b8c463 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:57.305474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbcfe-6be8-4351-8896-83b599b8c463 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:57.307100 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 248/486] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:58:57.312283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f5445-034d-4681-94c8-1d2d033e10a6 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:57.312567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f5445-034d-4681-94c8-1d2d033e10a6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:57.312849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f5445-034d-4681-94c8-1d2d033e10a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:57.352284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b04f5445-034d-4681-94c8-1d2d033e10a6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:57.353479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b04f5445-034d-4681-94c8-1d2d033e10a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:57.424466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:57.447257 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e5c8e-1944-48e6-a3c9-ccf4bd86f152 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:57.462728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 249/487] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:58:57.463755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f5445-034d-4681-94c8-1d2d033e10a6 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:57.517412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c480cda-4f6c-4274-8eef-4cebf94dd0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:57.517939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c480cda-4f6c-4274-8eef-4cebf94dd0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:57.518220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c480cda-4f6c-4274-8eef-4cebf94dd0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:57.518483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c480cda-4f6c-4274-8eef-4cebf94dd0b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:57.519150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c480cda-4f6c-4274-8eef-4cebf94dd0b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:57.519449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c480cda-4f6c-4274-8eef-4cebf94dd0b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:57.520852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c480cda-4f6c-4274-8eef-4cebf94dd0b9 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:57.537556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 239/488] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:58:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:57.542964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c480cda-4f6c-4274-8eef-4cebf94dd0b9 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:57.631074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f5445-034d-4681-94c8-1d2d033e10a6 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:57.644359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:57.704237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ab880-1264-4cb2-b10b-1831f4b2caf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:57.704879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ab880-1264-4cb2-b10b-1831f4b2caf2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:57.705157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ab880-1264-4cb2-b10b-1831f4b2caf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:57.705429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ab880-1264-4cb2-b10b-1831f4b2caf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:57.721946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c480cda-4f6c-4274-8eef-4cebf94dd0b9 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:57.726254 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ab880-1264-4cb2-b10b-1831f4b2caf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-f96ab880-1264-4cb2-b10b-1831f4b2caf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:57.731198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:57.733318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:57.735242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 250/489] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:58:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:57.741059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ab880-1264-4cb2-b10b-1831f4b2caf2 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:57.788134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac91b4-b07d-45d7-b088-e7deaf936e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:57.788727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac91b4-b07d-45d7-b088-e7deaf936e67 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:57.789093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac91b4-b07d-45d7-b088-e7deaf936e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:57.789376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac91b4-b07d-45d7-b088-e7deaf936e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:57.796000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:57.802230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac91b4-b07d-45d7-b088-e7deaf936e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:57.804137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac91b4-b07d-45d7-b088-e7deaf936e67 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-91ac91b4-b07d-45d7-b088-e7deaf936e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:57.823378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:57.825078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:57.826329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:57.826329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:57.826329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:57.826329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 240/490] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:58:57.826329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac91b4-b07d-45d7-b088-e7deaf936e67 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:57.879518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ab880-1264-4cb2-b10b-1831f4b2caf2 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:57.916381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2b7e-39f7-40f5-8050-b4acb3159718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:57.917101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2b7e-39f7-40f5-8050-b4acb3159718 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:57.917443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2b7e-39f7-40f5-8050-b4acb3159718 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:57.917801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2b7e-39f7-40f5-8050-b4acb3159718 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:57.918537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd2b7e-39f7-40f5-8050-b4acb3159718 None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:57.919415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd2b7e-39f7-40f5-8050-b4acb3159718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:57.920918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd2b7e-39f7-40f5-8050-b4acb3159718 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:57.932828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 251/491] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:58:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:57.933727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2b7e-39f7-40f5-8050-b4acb3159718 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:57.956234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac91b4-b07d-45d7-b088-e7deaf936e67 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:57.968416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:57.994585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b640917-4c87-451d-898d-bb0dae557f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:57.995229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b640917-4c87-451d-898d-bb0dae557f52 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:57.995493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b640917-4c87-451d-898d-bb0dae557f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:57.995794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b640917-4c87-451d-898d-bb0dae557f52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.009717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b640917-4c87-451d-898d-bb0dae557f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-0b640917-4c87-451d-898d-bb0dae557f52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:58.014768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:58.015850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:58.016673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 241/492] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:58:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:58.017329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b640917-4c87-451d-898d-bb0dae557f52 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.053155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:58.059595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2b7e-39f7-40f5-8050-b4acb3159718 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.095238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97053d8-92c6-4ca4-a61c-6075f14fc8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:58.095887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97053d8-92c6-4ca4-a61c-6075f14fc8aa None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.096167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97053d8-92c6-4ca4-a61c-6075f14fc8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.096437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97053d8-92c6-4ca4-a61c-6075f14fc8aa None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.097295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97053d8-92c6-4ca4-a61c-6075f14fc8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:58.097596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97053d8-92c6-4ca4-a61c-6075f14fc8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:58.099838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97053d8-92c6-4ca4-a61c-6075f14fc8aa None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:58.126906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 252/493] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:58.126906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed740ae-969b-43e5-8069-8aee94286209 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.126906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed740ae-969b-43e5-8069-8aee94286209 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.126906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed740ae-969b-43e5-8069-8aee94286209 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.126906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 253/494] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:58.127345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed740ae-969b-43e5-8069-8aee94286209 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.135220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b640917-4c87-451d-898d-bb0dae557f52 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.169353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfade35-f059-4a17-a2f6-a33b0ac324a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:58.169985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfade35-f059-4a17-a2f6-a33b0ac324a6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.170264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfade35-f059-4a17-a2f6-a33b0ac324a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.170598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfade35-f059-4a17-a2f6-a33b0ac324a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.182377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfade35-f059-4a17-a2f6-a33b0ac324a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:58.184186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfade35-f059-4a17-a2f6-a33b0ac324a6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-0cfade35-f059-4a17-a2f6-a33b0ac324a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:58.202469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:58.203432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:58.204324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:58.204324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:58.204324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:58.204324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 242/495] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:58.205098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfade35-f059-4a17-a2f6-a33b0ac324a6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.228055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:58.248148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed740ae-969b-43e5-8069-8aee94286209 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.283338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299a3de-d32f-474b-b56f-8ed49332be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:58.284338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a3de-d32f-474b-b56f-8ed49332be2d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.284810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a3de-d32f-474b-b56f-8ed49332be2d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.285270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a3de-d32f-474b-b56f-8ed49332be2d None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.286137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299a3de-d32f-474b-b56f-8ed49332be2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:58.286631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299a3de-d32f-474b-b56f-8ed49332be2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:58.288252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299a3de-d32f-474b-b56f-8ed49332be2d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:58.296559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 254/496] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:58.297975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc9081-58d9-4abb-a6d0-05db6e7e949d None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.298323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc9081-58d9-4abb-a6d0-05db6e7e949d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.298664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc9081-58d9-4abb-a6d0-05db6e7e949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.315880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfade35-f059-4a17-a2f6-a33b0ac324a6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.316755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-56dc9081-58d9-4abb-a6d0-05db6e7e949d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:58.317927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-56dc9081-58d9-4abb-a6d0-05db6e7e949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:58.333175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:58.356037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e650790-fc8a-48b2-a3b3-c8c148a390db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:58.356780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e650790-fc8a-48b2-a3b3-c8c148a390db None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.357064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e650790-fc8a-48b2-a3b3-c8c148a390db None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.357338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e650790-fc8a-48b2-a3b3-c8c148a390db None admin] PATH_INFO: `/v3/users/nova` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.365075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e650790-fc8a-48b2-a3b3-c8c148a390db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:58.366527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e650790-fc8a-48b2-a3b3-c8c148a390db None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-9e650790-fc8a-48b2-a3b3-c8c148a390db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:58:58.380213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:58.381166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 243/497] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:58.382050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e650790-fc8a-48b2-a3b3-c8c148a390db None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.400776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 255/498] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:58.402249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc9081-58d9-4abb-a6d0-05db6e7e949d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.498811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:58.523517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e650790-fc8a-48b2-a3b3-c8c148a390db None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.547614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc9081-58d9-4abb-a6d0-05db6e7e949d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.561788 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f4051-7259-4b98-b5f0-a01cf97ca35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:58.562405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f4051-7259-4b98-b5f0-a01cf97ca35d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.562675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f4051-7259-4b98-b5f0-a01cf97ca35d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.562963 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f4051-7259-4b98-b5f0-a01cf97ca35d None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.563613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f4051-7259-4b98-b5f0-a01cf97ca35d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:58.563932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f4051-7259-4b98-b5f0-a01cf97ca35d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:58.565316 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f4051-7259-4b98-b5f0-a01cf97ca35d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:58.577753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 244/499] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:58.578513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f4051-7259-4b98-b5f0-a01cf97ca35d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.586756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b73934-4d4f-4a63-b3eb-441c27943088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:58.587384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b73934-4d4f-4a63-b3eb-441c27943088 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.587760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b73934-4d4f-4a63-b3eb-441c27943088 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.588036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b73934-4d4f-4a63-b3eb-441c27943088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.598062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b73934-4d4f-4a63-b3eb-441c27943088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:58.599479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b73934-4d4f-4a63-b3eb-441c27943088 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:58.609464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-e5b73934-4d4f-4a63-b3eb-441c27943088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:58.616063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:58.625788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:58.626626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:58.626626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:58.626626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:58.626626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 256/500] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:58.626626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87698c1-a184-4af5-a136-e889ad365517 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.626626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87698c1-a184-4af5-a136-e889ad365517 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.626626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87698c1-a184-4af5-a136-e889ad365517 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.626626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 257/501] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:58:58.626626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87698c1-a184-4af5-a136-e889ad365517 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.693913 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f4051-7259-4b98-b5f0-a01cf97ca35d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.725932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87698c1-a184-4af5-a136-e889ad365517 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.727300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dd358-449e-4bf9-a133-5982bdc50edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:58.727937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd358-449e-4bf9-a133-5982bdc50edf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.728218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd358-449e-4bf9-a133-5982bdc50edf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.728495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd358-449e-4bf9-a133-5982bdc50edf None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.729220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd358-449e-4bf9-a133-5982bdc50edf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:58.729528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd358-449e-4bf9-a133-5982bdc50edf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:58.730987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd358-449e-4bf9-a133-5982bdc50edf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:58.755899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:58.760595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fda330-73f9-47cc-a287-b7d2f206f588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:58.761281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fda330-73f9-47cc-a287-b7d2f206f588 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.761563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fda330-73f9-47cc-a287-b7d2f206f588 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.761832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fda330-73f9-47cc-a287-b7d2f206f588 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.768021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 245/502] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:58.769273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ac0d-767e-4cd9-82ad-b76c31d30c33 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.769564 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ac0d-767e-4cd9-82ad-b76c31d30c33 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.769845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ac0d-767e-4cd9-82ad-b76c31d30c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.771848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fda330-73f9-47cc-a287-b7d2f206f588 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:58.773962 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fda330-73f9-47cc-a287-b7d2f206f588 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-c6fda330-73f9-47cc-a287-b7d2f206f588 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:58:58.786810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:58.787826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:58.788757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 258/503] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:58.789968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-0864ac0d-767e-4cd9-82ad-b76c31d30c33 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:58.790047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fda330-73f9-47cc-a287-b7d2f206f588 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.790120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0864ac0d-767e-4cd9-82ad-b76c31d30c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:58.852801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:58.856636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 246/504] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:58:58.857477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ac0d-767e-4cd9-82ad-b76c31d30c33 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.894930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fda330-73f9-47cc-a287-b7d2f206f588 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.929779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffa179-89ef-41e0-a2fb-5aa695fba269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:58.930687 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffa179-89ef-41e0-a2fb-5aa695fba269 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:58.931396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffa179-89ef-41e0-a2fb-5aa695fba269 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:58.931681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffa179-89ef-41e0-a2fb-5aa695fba269 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:58.932520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffa179-89ef-41e0-a2fb-5aa695fba269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:58.933024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffa179-89ef-41e0-a2fb-5aa695fba269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:58.934625 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffa179-89ef-41e0-a2fb-5aa695fba269 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:58.947696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 259/505] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:58.949404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffa179-89ef-41e0-a2fb-5aa695fba269 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:58.961654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ac0d-767e-4cd9-82ad-b76c31d30c33 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:58.990615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:58.999640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94546beb-22c9-4d26-9143-52633ed0cc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.000280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94546beb-22c9-4d26-9143-52633ed0cc36 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.000564 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94546beb-22c9-4d26-9143-52633ed0cc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.001047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94546beb-22c9-4d26-9143-52633ed0cc36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.011562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94546beb-22c9-4d26-9143-52633ed0cc36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-94546beb-22c9-4d26-9143-52633ed0cc36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:58:59.016730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:59.017834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:59.018620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 247/506] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:59.019270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94546beb-22c9-4d26-9143-52633ed0cc36 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.067979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffa179-89ef-41e0-a2fb-5aa695fba269 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.088838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:59.105125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9664-fd3d-4cc9-b3d7-da4a927d65ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.105438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9664-fd3d-4cc9-b3d7-da4a927d65ca None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.105683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9664-fd3d-4cc9-b3d7-da4a927d65ca None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.105958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9664-fd3d-4cc9-b3d7-da4a927d65ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.129644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94546beb-22c9-4d26-9143-52633ed0cc36 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.165222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c865-e643-463c-81c4-ea70025ab7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.165917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c865-e643-463c-81c4-ea70025ab7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.166199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c865-e643-463c-81c4-ea70025ab7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.166477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c865-e643-463c-81c4-ea70025ab7e4 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.167194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293c865-e643-463c-81c4-ea70025ab7e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:59.167499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293c865-e643-463c-81c4-ea70025ab7e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.169065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293c865-e643-463c-81c4-ea70025ab7e4 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.178910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f9664-fd3d-4cc9-b3d7-da4a927d65ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.180407 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f9664-fd3d-4cc9-b3d7-da4a927d65ca None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.185860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 248/507] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:59.186674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c865-e643-463c-81c4-ea70025ab7e4 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.235456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:59.280618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 260/508] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:59.281746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9664-fd3d-4cc9-b3d7-da4a927d65ca None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.292607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c865-e643-463c-81c4-ea70025ab7e4 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.303705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:59.328794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5f8df-b155-4140-9059-b1bac8ecc4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.329435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f8df-b155-4140-9059-b1bac8ecc4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.329720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f8df-b155-4140-9059-b1bac8ecc4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.329999 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f8df-b155-4140-9059-b1bac8ecc4c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.339214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5f8df-b155-4140-9059-b1bac8ecc4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.340730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5f8df-b155-4140-9059-b1bac8ecc4c0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-7ec5f8df-b155-4140-9059-b1bac8ecc4c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:58:59.352856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:59.354132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:58:59.355266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:59.359831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 249/509] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:59.362060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5f8df-b155-4140-9059-b1bac8ecc4c0 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.393208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9664-fd3d-4cc9-b3d7-da4a927d65ca None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.433481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8587b-e3ed-4580-b46c-481bacc253d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.434475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8587b-e3ed-4580-b46c-481bacc253d7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.434961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8587b-e3ed-4580-b46c-481bacc253d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.435451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8587b-e3ed-4580-b46c-481bacc253d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.436677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8587b-e3ed-4580-b46c-481bacc253d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:59.437034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8587b-e3ed-4580-b46c-481bacc253d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.438434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8587b-e3ed-4580-b46c-481bacc253d7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.452966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 261/510] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:59.452966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8587b-e3ed-4580-b46c-481bacc253d7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.477362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5f8df-b155-4140-9059-b1bac8ecc4c0 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.485766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:59.516821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c061e-d672-4af8-8d14-c34d2c9ce834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.517477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c061e-d672-4af8-8d14-c34d2c9ce834 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.517731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c061e-d672-4af8-8d14-c34d2c9ce834 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.518007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c061e-d672-4af8-8d14-c34d2c9ce834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.529240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c061e-d672-4af8-8d14-c34d2c9ce834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.530712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c061e-d672-4af8-8d14-c34d2c9ce834 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.538794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-291c061e-d672-4af8-8d14-c34d2c9ce834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:59.545438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:59.551970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:59.552821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:59.552821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:59.552821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:59.552821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 250/511] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:59.552821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c061e-d672-4af8-8d14-c34d2c9ce834 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.561732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8587b-e3ed-4580-b46c-481bacc253d7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.595354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11213f-3cfa-4293-915a-cf44e560d6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.595991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11213f-3cfa-4293-915a-cf44e560d6ef None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.596278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11213f-3cfa-4293-915a-cf44e560d6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.596563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11213f-3cfa-4293-915a-cf44e560d6ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.647355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c061e-d672-4af8-8d14-c34d2c9ce834 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.662760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11213f-3cfa-4293-915a-cf44e560d6ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.664275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11213f-3cfa-4293-915a-cf44e560d6ef None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.680165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a898ead-ca09-429d-9270-c59fa71ac465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.680894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a898ead-ca09-429d-9270-c59fa71ac465 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.681268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a898ead-ca09-429d-9270-c59fa71ac465 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.681614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a898ead-ca09-429d-9270-c59fa71ac465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.692774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a898ead-ca09-429d-9270-c59fa71ac465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.694302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a898ead-ca09-429d-9270-c59fa71ac465 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-5a898ead-ca09-429d-9270-c59fa71ac465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:59.709156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:59.710201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:59.711075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:59.711075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:59.711075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:58:59.711075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 251/512] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:59.711075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a898ead-ca09-429d-9270-c59fa71ac465 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.727278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:59.745377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:59.768271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 262/513] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:58:59.769139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11213f-3cfa-4293-915a-cf44e560d6ef None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.821144 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a898ead-ca09-429d-9270-c59fa71ac465 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.854824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acaf8e-f940-4b37-b950-e7ef0bcd6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.855428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acaf8e-f940-4b37-b950-e7ef0bcd6acf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.855743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acaf8e-f940-4b37-b950-e7ef0bcd6acf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.856021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acaf8e-f940-4b37-b950-e7ef0bcd6acf None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.856749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acaf8e-f940-4b37-b950-e7ef0bcd6acf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:59.857059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acaf8e-f940-4b37-b950-e7ef0bcd6acf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.858486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acaf8e-f940-4b37-b950-e7ef0bcd6acf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.868314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11213f-3cfa-4293-915a-cf44e560d6ef None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.876175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 252/514] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:59.876912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acaf8e-f940-4b37-b950-e7ef0bcd6acf None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.905868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971830f4-d5c2-444d-afa7-2e8351d216c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.906424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971830f4-d5c2-444d-afa7-2e8351d216c8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.906701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971830f4-d5c2-444d-afa7-2e8351d216c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.907146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971830f4-d5c2-444d-afa7-2e8351d216c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.917304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971830f4-d5c2-444d-afa7-2e8351d216c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.918760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971830f4-d5c2-444d-afa7-2e8351d216c8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-971830f4-d5c2-444d-afa7-2e8351d216c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:58:59.934604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:58:59.935501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:58:59.936833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:58:59.936833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:58:59.936833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:58:59.936833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 263/515] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:58:59.936833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971830f4-d5c2-444d-afa7-2e8351d216c8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.944988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:59.970539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:59.978543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acaf8e-f940-4b37-b950-e7ef0bcd6acf None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.012676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e887f-9f7f-4807-a119-2450a3b36829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.013290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e887f-9f7f-4807-a119-2450a3b36829 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.013570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e887f-9f7f-4807-a119-2450a3b36829 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.013843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e887f-9f7f-4807-a119-2450a3b36829 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.014477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e887f-9f7f-4807-a119-2450a3b36829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:00.014782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e887f-9f7f-4807-a119-2450a3b36829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.016197 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e887f-9f7f-4807-a119-2450a3b36829 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.027591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 253/516] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:00.028417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e887f-9f7f-4807-a119-2450a3b36829 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.042051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971830f4-d5c2-444d-afa7-2e8351d216c8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.075309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02980d21-c4a8-4166-8022-2ba69712cc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.075941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02980d21-c4a8-4166-8022-2ba69712cc83 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.076224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02980d21-c4a8-4166-8022-2ba69712cc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.076506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02980d21-c4a8-4166-8022-2ba69712cc83 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.077144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02980d21-c4a8-4166-8022-2ba69712cc83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:00.077448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02980d21-c4a8-4166-8022-2ba69712cc83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.078806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02980d21-c4a8-4166-8022-2ba69712cc83 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.090265 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 264/517] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:00.091084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02980d21-c4a8-4166-8022-2ba69712cc83 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.132959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e887f-9f7f-4807-a119-2450a3b36829 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.159247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:00.167311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd06e1-7e09-4630-9139-4d622935eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.167987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd06e1-7e09-4630-9139-4d622935eea1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.168276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd06e1-7e09-4630-9139-4d622935eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.168554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd06e1-7e09-4630-9139-4d622935eea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.178772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd06e1-7e09-4630-9139-4d622935eea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.180926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd06e1-7e09-4630-9139-4d622935eea1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.184732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:00.191249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02980d21-c4a8-4166-8022-2ba69712cc83 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-bedd06e1-7e09-4630-9139-4d622935eea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:00.194983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:00.195965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:00.197283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:00.197283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:00.197283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:00.197283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 254/518] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:00.197283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd06e1-7e09-4630-9139-4d622935eea1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.225548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edd688-1ea4-43a7-8c60-d654d8710f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.226158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd688-1ea4-43a7-8c60-d654d8710f41 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.226439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd688-1ea4-43a7-8c60-d654d8710f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.227369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd688-1ea4-43a7-8c60-d654d8710f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.294208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edd688-1ea4-43a7-8c60-d654d8710f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.295706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edd688-1ea4-43a7-8c60-d654d8710f41 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.297934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd06e1-7e09-4630-9139-4d622935eea1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.331581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f1a84-cda2-40f4-a15f-dba5a311e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.332216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f1a84-cda2-40f4-a15f-dba5a311e443 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.332499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f1a84-cda2-40f4-a15f-dba5a311e443 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.332774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f1a84-cda2-40f4-a15f-dba5a311e443 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.333414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f1a84-cda2-40f4-a15f-dba5a311e443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:00.333719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f1a84-cda2-40f4-a15f-dba5a311e443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.335083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f1a84-cda2-40f4-a15f-dba5a311e443 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.347132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 255/519] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:00.347941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f1a84-cda2-40f4-a15f-dba5a311e443 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.388379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:00.389369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:00.395442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 265/520] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:00.396285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edd688-1ea4-43a7-8c60-d654d8710f41 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.448958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f1a84-cda2-40f4-a15f-dba5a311e443 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.485189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b35fa-54b7-4f70-be10-d1ca53f2484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.485798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b35fa-54b7-4f70-be10-d1ca53f2484e None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.486079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b35fa-54b7-4f70-be10-d1ca53f2484e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.486355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b35fa-54b7-4f70-be10-d1ca53f2484e None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.487000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b35fa-54b7-4f70-be10-d1ca53f2484e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.488460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b35fa-54b7-4f70-be10-d1ca53f2484e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.498085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edd688-1ea4-43a7-8c60-d654d8710f41 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.531382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4213-cf08-4c55-9002-ca13bb167779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.532029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4213-cf08-4c55-9002-ca13bb167779 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.532309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4213-cf08-4c55-9002-ca13bb167779 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.532577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4213-cf08-4c55-9002-ca13bb167779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.538869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4213-cf08-4c55-9002-ca13bb167779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.541078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4213-cf08-4c55-9002-ca13bb167779 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-524d4213-cf08-4c55-9002-ca13bb167779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:00.553647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:00.554727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:00.556210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:00.556210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:00.556210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:00.556210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:00.556210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:00.556210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:00.556210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:00.556210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:00.558413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 256/521] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:59:00 2022] POST /identity/v3/users => generated 247 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:00.559304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b35fa-54b7-4f70-be10-d1ca53f2484e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.559870 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 266/522] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:00.560662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4213-cf08-4c55-9002-ca13bb167779 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.630820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:00.681326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:00.682928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4213-cf08-4c55-9002-ca13bb167779 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.690829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b35fa-54b7-4f70-be10-d1ca53f2484e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.727735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99090e8a-c324-40dc-bfae-12b20779392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.728302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99090e8a-c324-40dc-bfae-12b20779392c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.728665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99090e8a-c324-40dc-bfae-12b20779392c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.728933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99090e8a-c324-40dc-bfae-12b20779392c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.732236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04880ef-617a-4907-b994-6506c9756209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.732750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04880ef-617a-4907-b994-6506c9756209 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.733730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04880ef-617a-4907-b994-6506c9756209 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.733730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04880ef-617a-4907-b994-6506c9756209 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.733950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04880ef-617a-4907-b994-6506c9756209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:00.734230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04880ef-617a-4907-b994-6506c9756209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.735814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04880ef-617a-4907-b994-6506c9756209 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.738151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99090e8a-c324-40dc-bfae-12b20779392c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.739607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99090e8a-c324-40dc-bfae-12b20779392c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.748905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 257/523] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:00.750340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04880ef-617a-4907-b994-6506c9756209 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-99090e8a-c324-40dc-bfae-12b20779392c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:00.752405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:00.753920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 267/524] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:00.755088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99090e8a-c324-40dc-bfae-12b20779392c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.864124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04880ef-617a-4907-b994-6506c9756209 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.864768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99090e8a-c324-40dc-bfae-12b20779392c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:00.878982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:00.899641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2ac2c-62f4-4223-9bdb-03d79686c0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.900275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2ac2c-62f4-4223-9bdb-03d79686c0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.900559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2ac2c-62f4-4223-9bdb-03d79686c0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.900833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2ac2c-62f4-4223-9bdb-03d79686c0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.901168 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bd342-0fef-434c-bd63-0be919b7ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:00.901802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bd342-0fef-434c-bd63-0be919b7ee3d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:00.902082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bd342-0fef-434c-bd63-0be919b7ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:00.902360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bd342-0fef-434c-bd63-0be919b7ee3d None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:00.903057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bd342-0fef-434c-bd63-0be919b7ee3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:00.903370 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bd342-0fef-434c-bd63-0be919b7ee3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.904841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bd342-0fef-434c-bd63-0be919b7ee3d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.911886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2ac2c-62f4-4223-9bdb-03d79686c0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:00.913427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2ac2c-62f4-4223-9bdb-03d79686c0c4 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:00.924694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 268/525] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:00.925519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bd342-0fef-434c-bd63-0be919b7ee3d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-47d2ac2c-62f4-4223-9bdb-03d79686c0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:00.928350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:00.929357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:00.930282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:00.930282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:00.930282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:00.930282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 258/526] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:00.930282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2ac2c-62f4-4223-9bdb-03d79686c0c4 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:00.941621 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:01.035955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bd342-0fef-434c-bd63-0be919b7ee3d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:01.039259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2ac2c-62f4-4223-9bdb-03d79686c0c4 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:01.074686 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8aa51-5ab8-41b4-b4c9-6b9374081943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:01.075013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee10d-8d82-419d-912f-a9c39f99ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:01.075325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8aa51-5ab8-41b4-b4c9-6b9374081943 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:01.075606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8aa51-5ab8-41b4-b4c9-6b9374081943 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:01.075735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee10d-8d82-419d-912f-a9c39f99ed53 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:01.075947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8aa51-5ab8-41b4-b4c9-6b9374081943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:01.076056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee10d-8d82-419d-912f-a9c39f99ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:01.076249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee10d-8d82-419d-912f-a9c39f99ed53 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:01.076973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ee10d-8d82-419d-912f-a9c39f99ed53 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:01.077282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ee10d-8d82-419d-912f-a9c39f99ed53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:01.078709 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ee10d-8d82-419d-912f-a9c39f99ed53 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:01.083926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8aa51-5ab8-41b4-b4c9-6b9374081943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:01.085363 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8aa51-5ab8-41b4-b4c9-6b9374081943 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:01.096198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 259/527] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:01.097126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee10d-8d82-419d-912f-a9c39f99ed53 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-82f8aa51-5ab8-41b4-b4c9-6b9374081943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:01.098940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:01.099799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:01.100648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:01.100648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:01.100648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:01.100648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:01.100648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:01.100648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:01.100648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:01.100648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:01.102736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 269/528] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:01.103722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8aa51-5ab8-41b4-b4c9-6b9374081943 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:01.143615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:01.173600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:01.211081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee10d-8d82-419d-912f-a9c39f99ed53 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:01.211281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8aa51-5ab8-41b4-b4c9-6b9374081943 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:01.246871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131bec-b21b-42b9-9fb0-810c59e3d9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:01.247752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131bec-b21b-42b9-9fb0-810c59e3d9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:01.248036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131bec-b21b-42b9-9fb0-810c59e3d9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:01.248254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f08b9a-a5cc-4588-a38d-e76a91527d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:01.248366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131bec-b21b-42b9-9fb0-810c59e3d9d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:01.248855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f08b9a-a5cc-4588-a38d-e76a91527d41 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:01.248949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131bec-b21b-42b9-9fb0-810c59e3d9d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:01.249134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f08b9a-a5cc-4588-a38d-e76a91527d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:01.249234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131bec-b21b-42b9-9fb0-810c59e3d9d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:01.249665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f08b9a-a5cc-4588-a38d-e76a91527d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:01.250375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f08b9a-a5cc-4588-a38d-e76a91527d41 None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=4971acb91bbf498887606c5ba5d00176) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:01.250685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f08b9a-a5cc-4588-a38d-e76a91527d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:01.250965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131bec-b21b-42b9-9fb0-810c59e3d9d8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:01.252208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f08b9a-a5cc-4588-a38d-e76a91527d41 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:01.268037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 260/529] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:01 2022] GET /identity/v3/role_assignments?user.id=4971acb91bbf498887606c5ba5d00176&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:01.268037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f08b9a-a5cc-4588-a38d-e76a91527d41 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:01.275680 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 270/530] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:01.276778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131bec-b21b-42b9-9fb0-810c59e3d9d8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:01.390701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:01.399282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131bec-b21b-42b9-9fb0-810c59e3d9d8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:01.405822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f08b9a-a5cc-4588-a38d-e76a91527d41 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:01.441308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b4a71-2ac6-43a5-9c10-2566eea8832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:01.442120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b4a71-2ac6-43a5-9c10-2566eea8832f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:01.442559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b4a71-2ac6-43a5-9c10-2566eea8832f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:01.442937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b4a71-2ac6-43a5-9c10-2566eea8832f None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:01.443654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:01.444398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b4a71-2ac6-43a5-9c10-2566eea8832f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:01.445374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b4a71-2ac6-43a5-9c10-2566eea8832f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:01.447248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b4a71-2ac6-43a5-9c10-2566eea8832f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:01.451250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a305db-135b-4c9e-9e7d-4cbfd5b4b22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:01.451909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a305db-135b-4c9e-9e7d-4cbfd5b4b22e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:01.452193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a305db-135b-4c9e-9e7d-4cbfd5b4b22e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:01.452529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a305db-135b-4c9e-9e7d-4cbfd5b4b22e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:01.462505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 271/531] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:01.463848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b4a71-2ac6-43a5-9c10-2566eea8832f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:01.556612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a305db-135b-4c9e-9e7d-4cbfd5b4b22e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:01.559262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a305db-135b-4c9e-9e7d-4cbfd5b4b22e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:01.599984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b4a71-2ac6-43a5-9c10-2566eea8832f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:01.647813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f0cf7-cea5-4051-8bc7-8366f847f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:01.649452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0cf7-cea5-4051-8bc7-8366f847f2bb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:01.649935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0cf7-cea5-4051-8bc7-8366f847f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:01.650650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0cf7-cea5-4051-8bc7-8366f847f2bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:01.660070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f0cf7-cea5-4051-8bc7-8366f847f2bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:01.662669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f0cf7-cea5-4051-8bc7-8366f847f2bb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:01.671489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 261/532] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:01.672456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a305db-135b-4c9e-9e7d-4cbfd5b4b22e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-5d8f0cf7-cea5-4051-8bc7-8366f847f2bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:01.678681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:01.679525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:01.680976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:01.680976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:01.680976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:01.680976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:01.680976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:01.680976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:01.680976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:01.680976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:01.683357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 272/533] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:01.684343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f0cf7-cea5-4051-8bc7-8366f847f2bb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:01.705148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:01.709508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:01.802833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a305db-135b-4c9e-9e7d-4cbfd5b4b22e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:01.806544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f0cf7-cea5-4051-8bc7-8366f847f2bb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:01.842851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adef78-48f5-49eb-959e-fb1c7f949780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:01.843653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adef78-48f5-49eb-959e-fb1c7f949780 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:01.844039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adef78-48f5-49eb-959e-fb1c7f949780 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:01.844410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adef78-48f5-49eb-959e-fb1c7f949780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:01.845241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adef78-48f5-49eb-959e-fb1c7f949780 None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=decb5421872c4034bbbaa8c3cd9dcb5d) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:01.845673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adef78-48f5-49eb-959e-fb1c7f949780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:01.847202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adef78-48f5-49eb-959e-fb1c7f949780 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:01.851337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797d0b5-00b9-4b9e-b39f-3c404d9024ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:01.853025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797d0b5-00b9-4b9e-b39f-3c404d9024ef None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:01.853476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797d0b5-00b9-4b9e-b39f-3c404d9024ef None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:01.853890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797d0b5-00b9-4b9e-b39f-3c404d9024ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:01.854688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 262/534] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:01 2022] GET /identity/v3/role_assignments?user.id=decb5421872c4034bbbaa8c3cd9dcb5d&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:01.855713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adef78-48f5-49eb-959e-fb1c7f949780 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:01.865925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797d0b5-00b9-4b9e-b39f-3c404d9024ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:01.867839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797d0b5-00b9-4b9e-b39f-3c404d9024ef None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0797d0b5-00b9-4b9e-b39f-3c404d9024ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:01.889126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:01.890257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:01.891177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:01.891177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:01.891177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:01.899356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 273/535] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:01.905112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797d0b5-00b9-4b9e-b39f-3c404d9024ef None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:02.034137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:02.043065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adef78-48f5-49eb-959e-fb1c7f949780 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:02.075767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:02.085373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5ddb5-6b1e-4aa7-8ffd-f114ce026369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:02.087698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5ddb5-6b1e-4aa7-8ffd-f114ce026369 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:02.088172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5ddb5-6b1e-4aa7-8ffd-f114ce026369 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:02.088596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5ddb5-6b1e-4aa7-8ffd-f114ce026369 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:02.089433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5ddb5-6b1e-4aa7-8ffd-f114ce026369 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:02.089889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5ddb5-6b1e-4aa7-8ffd-f114ce026369 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:02.091491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5ddb5-6b1e-4aa7-8ffd-f114ce026369 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:02.125076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 263/536] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:02.128185 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797d0b5-00b9-4b9e-b39f-3c404d9024ef None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:02.132808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5ddb5-6b1e-4aa7-8ffd-f114ce026369 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:02.197732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ee600-60a2-41f7-80bd-be105ea489d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:02.198830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ee600-60a2-41f7-80bd-be105ea489d7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:02.200112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ee600-60a2-41f7-80bd-be105ea489d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:02.201151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ee600-60a2-41f7-80bd-be105ea489d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:02.202188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ee600-60a2-41f7-80bd-be105ea489d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:02.203484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ee600-60a2-41f7-80bd-be105ea489d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:02.206289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ee600-60a2-41f7-80bd-be105ea489d7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:02.231992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 274/537] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:02.237478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ee600-60a2-41f7-80bd-be105ea489d7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:02.345379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5ddb5-6b1e-4aa7-8ffd-f114ce026369 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:02.405921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ee600-60a2-41f7-80bd-be105ea489d7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:02.406831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2eb88-f01b-408d-8907-2baebc32a584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:02.407588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2eb88-f01b-408d-8907-2baebc32a584 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:02.407893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2eb88-f01b-408d-8907-2baebc32a584 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:02.408262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2eb88-f01b-408d-8907-2baebc32a584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:02.408996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2eb88-f01b-408d-8907-2baebc32a584 None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=6ce95a25d894457d8cd45c30b38f014e) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:02.409311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2eb88-f01b-408d-8907-2baebc32a584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:02.410881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2eb88-f01b-408d-8907-2baebc32a584 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:02.423972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 264/538] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:02 2022] GET /identity/v3/role_assignments?user.id=6ce95a25d894457d8cd45c30b38f014e&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:02.438779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:02.455391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab54e80-7d08-44eb-b826-b458a07c9286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:02.456061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab54e80-7d08-44eb-b826-b458a07c9286 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:02.456351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab54e80-7d08-44eb-b826-b458a07c9286 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:02.456699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab54e80-7d08-44eb-b826-b458a07c9286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:02.472645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab54e80-7d08-44eb-b826-b458a07c9286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:02.474631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab54e80-7d08-44eb-b826-b458a07c9286 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-5ab54e80-7d08-44eb-b826-b458a07c9286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:02.494049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:02.494967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:02.495864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:02.495864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:02.495864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:02.495864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:02.495864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:02.495864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:02.495864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:02.495864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:02.498411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 275/539] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:02.504651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2eb88-f01b-408d-8907-2baebc32a584 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:02.533941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:02.625397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2eb88-f01b-408d-8907-2baebc32a584 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:02.661002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251875c-0684-45a6-9c26-a1d3fbdd4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:02.661676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251875c-0684-45a6-9c26-a1d3fbdd4f67 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:02.661955 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251875c-0684-45a6-9c26-a1d3fbdd4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:02.662226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251875c-0684-45a6-9c26-a1d3fbdd4f67 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:02.662960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251875c-0684-45a6-9c26-a1d3fbdd4f67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:02.663271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251875c-0684-45a6-9c26-a1d3fbdd4f67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:02.664787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251875c-0684-45a6-9c26-a1d3fbdd4f67 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:02.677189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 265/540] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:02.683283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab54e80-7d08-44eb-b826-b458a07c9286 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:02.823577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab54e80-7d08-44eb-b826-b458a07c9286 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:02.882412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7793d-7c01-4216-9c3c-45ce39d38e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:02.884202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7793d-7c01-4216-9c3c-45ce39d38e4c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:02.884799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7793d-7c01-4216-9c3c-45ce39d38e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:02.885381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7793d-7c01-4216-9c3c-45ce39d38e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:02.886768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7793d-7c01-4216-9c3c-45ce39d38e4c None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=88d492b570be4de4b6a6d85f6374ed31) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:02.887475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7793d-7c01-4216-9c3c-45ce39d38e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:02.889091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7793d-7c01-4216-9c3c-45ce39d38e4c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:02.897906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 276/541] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:02 2022] GET /identity/v3/role_assignments?user.id=88d492b570be4de4b6a6d85f6374ed31&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:03.005237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b79726-de41-4f76-87b2-c494a4867d37 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:03.005899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b79726-de41-4f76-87b2-c494a4867d37 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:03.006401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b79726-de41-4f76-87b2-c494a4867d37 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:03.008464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 266/542] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:03.014584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362411e8-a0ff-4369-b615-bf86b222fa53 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:03.015216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362411e8-a0ff-4369-b615-bf86b222fa53 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:03.015744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362411e8-a0ff-4369-b615-bf86b222fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:03.036483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-362411e8-a0ff-4369-b615-bf86b222fa53 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:03.038171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-362411e8-a0ff-4369-b615-bf86b222fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:03.098838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:03.138201 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 277/543] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:03.471814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b79726-de41-4f76-87b2-c494a4867d37 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:03.568439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:03.602690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b79726-de41-4f76-87b2-c494a4867d37 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:03.641967 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595357a-9148-49ed-b22f-5e3735099cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:03.642979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595357a-9148-49ed-b22f-5e3735099cba None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:03.643450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595357a-9148-49ed-b22f-5e3735099cba None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:03.643934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595357a-9148-49ed-b22f-5e3735099cba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:03.655501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595357a-9148-49ed-b22f-5e3735099cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-a595357a-9148-49ed-b22f-5e3735099cba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:03.661020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:03.661939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:03.662713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:03.665299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 267/544] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:03.673034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362411e8-a0ff-4369-b615-bf86b222fa53 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:03.809825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362411e8-a0ff-4369-b615-bf86b222fa53 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:03.849295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f895180-9c28-452d-9858-44edb31da7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:03.849921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f895180-9c28-452d-9858-44edb31da7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:03.850200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f895180-9c28-452d-9858-44edb31da7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:03.850474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f895180-9c28-452d-9858-44edb31da7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:03.851152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f895180-9c28-452d-9858-44edb31da7e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:03.851457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f895180-9c28-452d-9858-44edb31da7e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:03.853110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f895180-9c28-452d-9858-44edb31da7e5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:03.867611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 278/545] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:03.873254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595357a-9148-49ed-b22f-5e3735099cba None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:04.017721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d18b5-c1a6-4707-b6a5-cc5861bb70b0 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.018068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d18b5-c1a6-4707-b6a5-cc5861bb70b0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.018277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d18b5-c1a6-4707-b6a5-cc5861bb70b0 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.020749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 279/546] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:59:04.026579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb78a-ae4f-4a04-9b52-b3cab3ae17b1 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.026860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb78a-ae4f-4a04-9b52-b3cab3ae17b1 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.027130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb78a-ae4f-4a04-9b52-b3cab3ae17b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.045005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595357a-9148-49ed-b22f-5e3735099cba None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:04.045762 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-be6bb78a-ae4f-4a04-9b52-b3cab3ae17b1 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:04.046948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-be6bb78a-ae4f-4a04-9b52-b3cab3ae17b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:04.088034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:04.111095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfccfb-ed6b-4fde-b313-33c23710db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:04.112210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfccfb-ed6b-4fde-b313-33c23710db92 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.112683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfccfb-ed6b-4fde-b313-33c23710db92 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.113185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfccfb-ed6b-4fde-b313-33c23710db92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.129399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 280/547] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:59:04.135667 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:04.139671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfccfb-ed6b-4fde-b313-33c23710db92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:04.141244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfccfb-ed6b-4fde-b313-33c23710db92 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-41dfccfb-ed6b-4fde-b313-33c23710db92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:04.163729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:04.164764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:04.166106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:04.166106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:04.166106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:04.166106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 268/548] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:04.171443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bb78a-ae4f-4a04-9b52-b3cab3ae17b1 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:04.311209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bb78a-ae4f-4a04-9b52-b3cab3ae17b1 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:04.360531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca7e14-426b-4487-a63d-7328e24e73a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:04.361153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca7e14-426b-4487-a63d-7328e24e73a9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.361436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca7e14-426b-4487-a63d-7328e24e73a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.361708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca7e14-426b-4487-a63d-7328e24e73a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.362435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca7e14-426b-4487-a63d-7328e24e73a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:04.362737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca7e14-426b-4487-a63d-7328e24e73a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:04.364133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca7e14-426b-4487-a63d-7328e24e73a9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:04.377733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 281/549] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:04.383788 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfccfb-ed6b-4fde-b313-33c23710db92 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:04.471282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca7e14-426b-4487-a63d-7328e24e73a9 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:04.514708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfccfb-ed6b-4fde-b313-33c23710db92 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:04.532728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:04.588591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f102-dbd5-4819-8e18-ce852ad926ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:04.589235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f102-dbd5-4819-8e18-ce852ad926ef None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.589512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f102-dbd5-4819-8e18-ce852ad926ef None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.589783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f102-dbd5-4819-8e18-ce852ad926ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.603703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f102-dbd5-4819-8e18-ce852ad926ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:04.605425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f102-dbd5-4819-8e18-ce852ad926ef None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-f111f102-dbd5-4819-8e18-ce852ad926ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:04.637133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:04.638321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:04.639246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:04.639794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 269/550] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:04.642333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca7e14-426b-4487-a63d-7328e24e73a9 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:04.646548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f102-dbd5-4819-8e18-ce852ad926ef None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:04.678841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27aeec3-6a19-45b6-95a4-c8f60d0f9d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:04.679609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aeec3-6a19-45b6-95a4-c8f60d0f9d3b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.680493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aeec3-6a19-45b6-95a4-c8f60d0f9d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.680769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aeec3-6a19-45b6-95a4-c8f60d0f9d3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.701842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27aeec3-6a19-45b6-95a4-c8f60d0f9d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-c27aeec3-6a19-45b6-95a4-c8f60d0f9d3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:04.709996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:04.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:04.711823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:04.712472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 282/551] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:04.719056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27aeec3-6a19-45b6-95a4-c8f60d0f9d3b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:04.763261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:04.820029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f102-dbd5-4819-8e18-ce852ad926ef None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:04.835596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:04.846045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27aeec3-6a19-45b6-95a4-c8f60d0f9d3b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:04.861077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba78ebb-bc57-44df-9562-e16d769d38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:04.862023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba78ebb-bc57-44df-9562-e16d769d38a3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.862509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba78ebb-bc57-44df-9562-e16d769d38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.862987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba78ebb-bc57-44df-9562-e16d769d38a3 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.863959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba78ebb-bc57-44df-9562-e16d769d38a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:04.864568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba78ebb-bc57-44df-9562-e16d769d38a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:04.866882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba78ebb-bc57-44df-9562-e16d769d38a3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:04.884717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71a702-0ccf-4dfe-bbe5-ac73dd9b8fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:04.885324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71a702-0ccf-4dfe-bbe5-ac73dd9b8fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.885602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71a702-0ccf-4dfe-bbe5-ac73dd9b8fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.885890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71a702-0ccf-4dfe-bbe5-ac73dd9b8fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.886536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71a702-0ccf-4dfe-bbe5-ac73dd9b8fa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:04.886837 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71a702-0ccf-4dfe-bbe5-ac73dd9b8fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:04.888358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71a702-0ccf-4dfe-bbe5-ac73dd9b8fa0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:04.893741 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 270/552] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 11:59:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:04.895517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da8b1-3b17-4a75-9a63-fd4d03c408da None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.896068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da8b1-3b17-4a75-9a63-fd4d03c408da None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.896547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da8b1-3b17-4a75-9a63-fd4d03c408da None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.898334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 271/553] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:04.903459 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 283/554] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:04.904004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da8b1-3b17-4a75-9a63-fd4d03c408da None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:04.905088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c7514-5067-451f-baea-dc9584d52053 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:04.905313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c7514-5067-451f-baea-dc9584d52053 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:04.905590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c7514-5067-451f-baea-dc9584d52053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:04.928432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-263c7514-5067-451f-baea-dc9584d52053 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:04.929620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-263c7514-5067-451f-baea-dc9584d52053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:05.010979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 284/555] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:05.010979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c7514-5067-451f-baea-dc9584d52053 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:05.124874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da8b1-3b17-4a75-9a63-fd4d03c408da None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:05.141867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:05.171102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:05.195038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c7514-5067-451f-baea-dc9584d52053 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:05.199305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a05abe-7cd8-4a3f-a97c-7e02c215b6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:05.200207 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a05abe-7cd8-4a3f-a97c-7e02c215b6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.200692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a05abe-7cd8-4a3f-a97c-7e02c215b6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.201213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a05abe-7cd8-4a3f-a97c-7e02c215b6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.234270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0cbbb-a990-4b64-a380-c865680fd5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:05.235252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0cbbb-a990-4b64-a380-c865680fd5fa None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.235540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0cbbb-a990-4b64-a380-c865680fd5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.235855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0cbbb-a990-4b64-a380-c865680fd5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.248426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0cbbb-a990-4b64-a380-c865680fd5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:05.250143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0cbbb-a990-4b64-a380-c865680fd5fa None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-b5a0cbbb-a990-4b64-a380-c865680fd5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:05.269133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:05.270448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:05.271368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:05.271368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:05.271368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:05.276563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 285/556] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:05.278035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bb07d-2f37-4658-a60e-eb9aa7dc2725 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.278324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bb07d-2f37-4658-a60e-eb9aa7dc2725 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.278600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bb07d-2f37-4658-a60e-eb9aa7dc2725 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.280340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 286/557] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:05.281166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bb07d-2f37-4658-a60e-eb9aa7dc2725 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:05.305196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a05abe-7cd8-4a3f-a97c-7e02c215b6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:05.307704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a05abe-7cd8-4a3f-a97c-7e02c215b6e5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:05.406869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bb07d-2f37-4658-a60e-eb9aa7dc2725 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:05.412565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 272/558] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:05.413900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b536d-106b-4f3a-9244-daa4cb6a42c6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.414169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b536d-106b-4f3a-9244-daa4cb6a42c6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.414481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b536d-106b-4f3a-9244-daa4cb6a42c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.432277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e34b536d-106b-4f3a-9244-daa4cb6a42c6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:05.433506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e34b536d-106b-4f3a-9244-daa4cb6a42c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:05.435642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:05.442927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a3c54-fc43-43d4-af4b-098925f874b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:05.443541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3c54-fc43-43d4-af4b-098925f874b0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.448479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3c54-fc43-43d4-af4b-098925f874b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.448479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3c54-fc43-43d4-af4b-098925f874b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.448479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a3c54-fc43-43d4-af4b-098925f874b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:05.448479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a3c54-fc43-43d4-af4b-098925f874b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:05.448479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a3c54-fc43-43d4-af4b-098925f874b0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:05.450111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:05.460222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 287/559] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:05.461070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a3c54-fc43-43d4-af4b-098925f874b0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:05.502371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 273/560] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:05.503656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1eb1-7a11-42b2-8102-f1131503eef0 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.503927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1eb1-7a11-42b2-8102-f1131503eef0 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.504199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1eb1-7a11-42b2-8102-f1131503eef0 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.506878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 274/561] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:05.506878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1eb1-7a11-42b2-8102-f1131503eef0 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:05.577019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a3c54-fc43-43d4-af4b-098925f874b0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:05.613097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71290b7a-08af-4dd7-908f-860a21d43a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:05.613827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71290b7a-08af-4dd7-908f-860a21d43a11 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.614008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71290b7a-08af-4dd7-908f-860a21d43a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.614279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71290b7a-08af-4dd7-908f-860a21d43a11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.622519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1eb1-7a11-42b2-8102-f1131503eef0 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:05.625191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71290b7a-08af-4dd7-908f-860a21d43a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-71290b7a-08af-4dd7-908f-860a21d43a11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:05.629989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:05.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:05.631869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 288/562] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:05.632636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71290b7a-08af-4dd7-908f-860a21d43a11 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:05.663466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b693feb-fe08-480e-a201-6e8049347e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:05.664381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b693feb-fe08-480e-a201-6e8049347e6f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.664881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b693feb-fe08-480e-a201-6e8049347e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.665104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b693feb-fe08-480e-a201-6e8049347e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.671713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:05.675898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b693feb-fe08-480e-a201-6e8049347e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:05.677589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b693feb-fe08-480e-a201-6e8049347e6f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4b693feb-fe08-480e-a201-6e8049347e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:05.692771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:05.693925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:05.694845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:05.694845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:05.694845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:05.694845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 275/563] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:05.696280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859190-53ee-44c8-b4ce-e026fd9a494f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.696384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859190-53ee-44c8-b4ce-e026fd9a494f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.696645 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859190-53ee-44c8-b4ce-e026fd9a494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.704461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:05.714596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e7859190-53ee-44c8-b4ce-e026fd9a494f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:05.715811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e7859190-53ee-44c8-b4ce-e026fd9a494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:05.751289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71290b7a-08af-4dd7-908f-860a21d43a11 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:05.788503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88031c0-ae67-45e5-8911-dcdbff2118f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:05.789349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88031c0-ae67-45e5-8911-dcdbff2118f7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.789731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 276/564] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:05.789928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88031c0-ae67-45e5-8911-dcdbff2118f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.790204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88031c0-ae67-45e5-8911-dcdbff2118f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.790561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859190-53ee-44c8-b4ce-e026fd9a494f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:05.797688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88031c0-ae67-45e5-8911-dcdbff2118f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:05.799261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88031c0-ae67-45e5-8911-dcdbff2118f7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-f88031c0-ae67-45e5-8911-dcdbff2118f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:05.812320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:05.813325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 289/565] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 11:59:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:05.814283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88031c0-ae67-45e5-8911-dcdbff2118f7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:05.910498 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859190-53ee-44c8-b4ce-e026fd9a494f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:05.926594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88031c0-ae67-45e5-8911-dcdbff2118f7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:05.934499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:05.944646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:05.950030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc42ecf-e92b-4103-8c59-458106a66d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:05.950642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc42ecf-e92b-4103-8c59-458106a66d4c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.950925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc42ecf-e92b-4103-8c59-458106a66d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.951300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc42ecf-e92b-4103-8c59-458106a66d4c None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.952453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc42ecf-e92b-4103-8c59-458106a66d4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:05.952453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc42ecf-e92b-4103-8c59-458106a66d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:05.953731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc42ecf-e92b-4103-8c59-458106a66d4c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:05.962935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 277/566] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:05.963869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc42ecf-e92b-4103-8c59-458106a66d4c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:05.968508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb97a8-88db-4600-aaf3-f909edce26a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:05.969124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb97a8-88db-4600-aaf3-f909edce26a1 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:05.969410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb97a8-88db-4600-aaf3-f909edce26a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:05.969684 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb97a8-88db-4600-aaf3-f909edce26a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:05.970337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb97a8-88db-4600-aaf3-f909edce26a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:05.970641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb97a8-88db-4600-aaf3-f909edce26a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:05.972048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb97a8-88db-4600-aaf3-f909edce26a1 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:05.986018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 290/567] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:05.987390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb97a8-88db-4600-aaf3-f909edce26a1 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.086903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc42ecf-e92b-4103-8c59-458106a66d4c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.093570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb97a8-88db-4600-aaf3-f909edce26a1 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.123016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587ef6e-67b8-4213-9257-4831fbd5d673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.123676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ef6e-67b8-4213-9257-4831fbd5d673 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.124005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ef6e-67b8-4213-9257-4831fbd5d673 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.124224 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ef6e-67b8-4213-9257-4831fbd5d673 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.135814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587ef6e-67b8-4213-9257-4831fbd5d673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:06.135988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf32c66-0795-49ad-92af-2f442cf767a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.136580 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf32c66-0795-49ad-92af-2f442cf767a8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.136866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf32c66-0795-49ad-92af-2f442cf767a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.137145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf32c66-0795-49ad-92af-2f442cf767a8 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.137885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf32c66-0795-49ad-92af-2f442cf767a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:06.138196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf32c66-0795-49ad-92af-2f442cf767a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:06.139807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf32c66-0795-49ad-92af-2f442cf767a8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4587ef6e-67b8-4213-9257-4831fbd5d673 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:06.142464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:06.143541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:06.144593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 278/568] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:06.145505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587ef6e-67b8-4213-9257-4831fbd5d673 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.188501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 291/569] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 11:59:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:06.189511 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf32c66-0795-49ad-92af-2f442cf767a8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.202128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.224008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.264647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587ef6e-67b8-4213-9257-4831fbd5d673 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.292912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf32c66-0795-49ad-92af-2f442cf767a8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.302461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6457d68-b28e-4093-be71-607c0a4b7c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.303201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6457d68-b28e-4093-be71-607c0a4b7c17 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.303486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6457d68-b28e-4093-be71-607c0a4b7c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.303859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6457d68-b28e-4093-be71-607c0a4b7c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.315735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6457d68-b28e-4093-be71-607c0a4b7c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:06.318326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6457d68-b28e-4093-be71-607c0a4b7c17 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:06.329299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29d9c8-1136-48cf-9e91-43e6abf958a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.329930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29d9c8-1136-48cf-9e91-43e6abf958a6 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.330214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29d9c8-1136-48cf-9e91-43e6abf958a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.330563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29d9c8-1136-48cf-9e91-43e6abf958a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-a6457d68-b28e-4093-be71-607c0a4b7c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:06.335816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:06.337409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:06.339478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:06.339478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:06.339478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:06.339478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 279/570] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:06.339757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6457d68-b28e-4093-be71-607c0a4b7c17 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.341362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29d9c8-1136-48cf-9e91-43e6abf958a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:06.342834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29d9c8-1136-48cf-9e91-43e6abf958a6 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-7e29d9c8-1136-48cf-9e91-43e6abf958a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:06.354994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:06.356221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 292/571] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:06.357264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29d9c8-1136-48cf-9e91-43e6abf958a6 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.449349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.456962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6457d68-b28e-4093-be71-607c0a4b7c17 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.459135 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.466454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29d9c8-1136-48cf-9e91-43e6abf958a6 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.500089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995c3e-b1f3-4473-91f7-05f949813067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.501115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995c3e-b1f3-4473-91f7-05f949813067 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.501443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995c3e-b1f3-4473-91f7-05f949813067 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.501782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995c3e-b1f3-4473-91f7-05f949813067 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.502028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f88d70-3125-47df-ace3-ee79caf3f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.503004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f88d70-3125-47df-ace3-ee79caf3f21d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.503531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f88d70-3125-47df-ace3-ee79caf3f21d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.504187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f88d70-3125-47df-ace3-ee79caf3f21d None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.504859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f88d70-3125-47df-ace3-ee79caf3f21d None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:06.505166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f88d70-3125-47df-ace3-ee79caf3f21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:06.506552 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f88d70-3125-47df-ace3-ee79caf3f21d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:06.512278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee995c3e-b1f3-4473-91f7-05f949813067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:06.514701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 293/572] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:06.517241 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f88d70-3125-47df-ace3-ee79caf3f21d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-ee995c3e-b1f3-4473-91f7-05f949813067 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:06.517372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:06.518255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 280/573] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:06.520566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995c3e-b1f3-4473-91f7-05f949813067 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.631173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995c3e-b1f3-4473-91f7-05f949813067 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.632634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f88d70-3125-47df-ace3-ee79caf3f21d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.669719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e17d0-65f8-4919-af0e-0a321f965dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.670508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e17d0-65f8-4919-af0e-0a321f965dde None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.670793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e17d0-65f8-4919-af0e-0a321f965dde None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.671073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e17d0-65f8-4919-af0e-0a321f965dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.672260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88e545-0d7f-4c72-b02c-773b67f36adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.672260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88e545-0d7f-4c72-b02c-773b67f36adf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.672497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88e545-0d7f-4c72-b02c-773b67f36adf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.672714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88e545-0d7f-4c72-b02c-773b67f36adf None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.673365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88e545-0d7f-4c72-b02c-773b67f36adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:06.673668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88e545-0d7f-4c72-b02c-773b67f36adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:06.675534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88e545-0d7f-4c72-b02c-773b67f36adf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:06.683838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e17d0-65f8-4919-af0e-0a321f965dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:06.685302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e17d0-65f8-4919-af0e-0a321f965dde None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:06.687561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 281/574] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:06.688442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88e545-0d7f-4c72-b02c-773b67f36adf None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.705926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-912e17d0-65f8-4919-af0e-0a321f965dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:06.707527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:06.708679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:06.709582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:06.709582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:06.709582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:06.709582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 294/575] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:06.709582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e17d0-65f8-4919-af0e-0a321f965dde None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.724066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.800628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88e545-0d7f-4c72-b02c-773b67f36adf None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.824229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e17d0-65f8-4919-af0e-0a321f965dde None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:06.837331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0ae88-d16d-4bf4-ba8e-d2a81728874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.837937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0ae88-d16d-4bf4-ba8e-d2a81728874b None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.838214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0ae88-d16d-4bf4-ba8e-d2a81728874b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.838490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0ae88-d16d-4bf4-ba8e-d2a81728874b None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.839173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0ae88-d16d-4bf4-ba8e-d2a81728874b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:06.839479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0ae88-d16d-4bf4-ba8e-d2a81728874b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:06.840937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0ae88-d16d-4bf4-ba8e-d2a81728874b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:06.854027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 282/576] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:06.854867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0ae88-d16d-4bf4-ba8e-d2a81728874b None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.865756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989d22c-c436-4a0e-aa5d-8479bc16e4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:06.866386 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989d22c-c436-4a0e-aa5d-8479bc16e4eb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:06.866667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989d22c-c436-4a0e-aa5d-8479bc16e4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:06.866942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989d22c-c436-4a0e-aa5d-8479bc16e4eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:06.878748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989d22c-c436-4a0e-aa5d-8479bc16e4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:06.880234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989d22c-c436-4a0e-aa5d-8479bc16e4eb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0989d22c-c436-4a0e-aa5d-8479bc16e4eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:06.895897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:06.897144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:06.898204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:06.898204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:06.898204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:06.898204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 295/577] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:06.898204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989d22c-c436-4a0e-aa5d-8479bc16e4eb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:06.952520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.971022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.976704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0ae88-d16d-4bf4-ba8e-d2a81728874b None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.011593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568f513-5e9f-4018-a89f-6b5eb2fae83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.012227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568f513-5e9f-4018-a89f-6b5eb2fae83b None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.012505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568f513-5e9f-4018-a89f-6b5eb2fae83b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.012775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568f513-5e9f-4018-a89f-6b5eb2fae83b None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.012958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989d22c-c436-4a0e-aa5d-8479bc16e4eb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.013423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568f513-5e9f-4018-a89f-6b5eb2fae83b None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:07.013723 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568f513-5e9f-4018-a89f-6b5eb2fae83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.015085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568f513-5e9f-4018-a89f-6b5eb2fae83b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.022980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 283/578] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:07.025307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568f513-5e9f-4018-a89f-6b5eb2fae83b None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.047802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e9771-c13d-48db-a7f6-fd0c7ae89b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.048446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e9771-c13d-48db-a7f6-fd0c7ae89b77 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.048727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e9771-c13d-48db-a7f6-fd0c7ae89b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.049006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e9771-c13d-48db-a7f6-fd0c7ae89b77 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.056518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e9771-c13d-48db-a7f6-fd0c7ae89b77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.057980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e9771-c13d-48db-a7f6-fd0c7ae89b77 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-591e9771-c13d-48db-a7f6-fd0c7ae89b77 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:07.069082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:07.070095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:59:07.071081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:07.074838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 296/579] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:07.075773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e9771-c13d-48db-a7f6-fd0c7ae89b77 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.129012 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568f513-5e9f-4018-a89f-6b5eb2fae83b None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.162914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039afc-70bb-4267-969e-03b7a164be73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.163528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039afc-70bb-4267-969e-03b7a164be73 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.163843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039afc-70bb-4267-969e-03b7a164be73 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.164124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039afc-70bb-4267-969e-03b7a164be73 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.165360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18039afc-70bb-4267-969e-03b7a164be73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:07.165667 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18039afc-70bb-4267-969e-03b7a164be73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.167058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18039afc-70bb-4267-969e-03b7a164be73 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.169794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:07.176742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e9771-c13d-48db-a7f6-fd0c7ae89b77 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.179960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 284/580] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:07.180783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039afc-70bb-4267-969e-03b7a164be73 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.197237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:07.212068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9256a61-41a7-451c-9f0d-9bb7c12c9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.212736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9256a61-41a7-451c-9f0d-9bb7c12c9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.213011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9256a61-41a7-451c-9f0d-9bb7c12c9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.213287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9256a61-41a7-451c-9f0d-9bb7c12c9aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.214001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9256a61-41a7-451c-9f0d-9bb7c12c9aa8 None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=063f7bf74f444c14b9bf6c0ca936dd12) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:07.214308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9256a61-41a7-451c-9f0d-9bb7c12c9aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.215761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9256a61-41a7-451c-9f0d-9bb7c12c9aa8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.224129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 297/581] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/role_assignments?user.id=063f7bf74f444c14b9bf6c0ca936dd12&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:07.224129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9256a61-41a7-451c-9f0d-9bb7c12c9aa8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.301445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039afc-70bb-4267-969e-03b7a164be73 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.340315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9256a61-41a7-451c-9f0d-9bb7c12c9aa8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.341970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9bfc-ebb9-4acc-9501-e24c87b48385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.343537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9bfc-ebb9-4acc-9501-e24c87b48385 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.343944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9bfc-ebb9-4acc-9501-e24c87b48385 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.344225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9bfc-ebb9-4acc-9501-e24c87b48385 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.344895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9bfc-ebb9-4acc-9501-e24c87b48385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:07.345197 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9bfc-ebb9-4acc-9501-e24c87b48385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.346595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9bfc-ebb9-4acc-9501-e24c87b48385 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.360439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 285/582] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:07.361331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9bfc-ebb9-4acc-9501-e24c87b48385 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.384145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1416f-ef73-4f73-90b3-76e5d6b21740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.384886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1416f-ef73-4f73-90b3-76e5d6b21740 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.385251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1416f-ef73-4f73-90b3-76e5d6b21740 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.385450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1416f-ef73-4f73-90b3-76e5d6b21740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.397738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1416f-ef73-4f73-90b3-76e5d6b21740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.399239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1416f-ef73-4f73-90b3-76e5d6b21740 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-e8f1416f-ef73-4f73-90b3-76e5d6b21740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:07.418919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:07.419996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:07.420910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:07.420910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:07.420910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:07.420910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 298/583] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:07.421144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1416f-ef73-4f73-90b3-76e5d6b21740 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.431218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:07.468866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:07.477703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9bfc-ebb9-4acc-9501-e24c87b48385 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.517175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda05bd-91bf-4b96-ba51-74b787399ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.518505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda05bd-91bf-4b96-ba51-74b787399ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.519306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda05bd-91bf-4b96-ba51-74b787399ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.520123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda05bd-91bf-4b96-ba51-74b787399ce6 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.521064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda05bd-91bf-4b96-ba51-74b787399ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:07.521741 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda05bd-91bf-4b96-ba51-74b787399ce6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.524664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda05bd-91bf-4b96-ba51-74b787399ce6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.542435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1416f-ef73-4f73-90b3-76e5d6b21740 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.547844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 286/584] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:07.548953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda05bd-91bf-4b96-ba51-74b787399ce6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.578164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebc9e4-f029-40a5-913f-5f4b07bff1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.578803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebc9e4-f029-40a5-913f-5f4b07bff1ce None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.579539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebc9e4-f029-40a5-913f-5f4b07bff1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.579851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebc9e4-f029-40a5-913f-5f4b07bff1ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.587766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebc9e4-f029-40a5-913f-5f4b07bff1ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.589222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebc9e4-f029-40a5-913f-5f4b07bff1ce None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-f7ebc9e4-f029-40a5-913f-5f4b07bff1ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:07.600683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:07.601630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 299/585] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:07.602583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebc9e4-f029-40a5-913f-5f4b07bff1ce None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.666005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda05bd-91bf-4b96-ba51-74b787399ce6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.681397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:07.705226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004282b8-76ff-4873-8aec-f1fe13f4ff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.705865 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004282b8-76ff-4873-8aec-f1fe13f4ff32 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.706150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004282b8-76ff-4873-8aec-f1fe13f4ff32 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.706415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004282b8-76ff-4873-8aec-f1fe13f4ff32 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.712549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:07.714636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004282b8-76ff-4873-8aec-f1fe13f4ff32 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.716217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004282b8-76ff-4873-8aec-f1fe13f4ff32 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.719197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebc9e4-f029-40a5-913f-5f4b07bff1ce None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-004282b8-76ff-4873-8aec-f1fe13f4ff32 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:07.728799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:07.729784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 287/586] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:07.731028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004282b8-76ff-4873-8aec-f1fe13f4ff32 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.759768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801bd02-a10e-4236-8504-fc3339e80a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.760715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801bd02-a10e-4236-8504-fc3339e80a50 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.761172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801bd02-a10e-4236-8504-fc3339e80a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.761641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801bd02-a10e-4236-8504-fc3339e80a50 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.762458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801bd02-a10e-4236-8504-fc3339e80a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:07.762940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801bd02-a10e-4236-8504-fc3339e80a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.764586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801bd02-a10e-4236-8504-fc3339e80a50 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.777369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 300/587] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:07.778482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801bd02-a10e-4236-8504-fc3339e80a50 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.842201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004282b8-76ff-4873-8aec-f1fe13f4ff32 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.879914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d912-a990-41b8-b734-ed1dff057acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.880828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d912-a990-41b8-b734-ed1dff057acf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.881111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d912-a990-41b8-b734-ed1dff057acf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.881387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d912-a990-41b8-b734-ed1dff057acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.886735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801bd02-a10e-4236-8504-fc3339e80a50 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:07.893637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d912-a990-41b8-b734-ed1dff057acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.895112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d912-a990-41b8-b734-ed1dff057acf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-7481d912-a990-41b8-b734-ed1dff057acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:07.910049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:07.911039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:07.911953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:07.911953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:07.911953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:07.911953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 288/588] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:07.911953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d912-a990-41b8-b734-ed1dff057acf None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.928627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920dba1-be49-4b2b-9219-ea49f25b72e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:07.929660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920dba1-be49-4b2b-9219-ea49f25b72e4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:07.930557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920dba1-be49-4b2b-9219-ea49f25b72e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:07.931015 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920dba1-be49-4b2b-9219-ea49f25b72e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:07.931755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920dba1-be49-4b2b-9219-ea49f25b72e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:07.932072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920dba1-be49-4b2b-9219-ea49f25b72e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:07.933509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920dba1-be49-4b2b-9219-ea49f25b72e4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:07.945248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:07.946971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 301/589] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:07.955768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920dba1-be49-4b2b-9219-ea49f25b72e4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:07.967472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:08.025417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d912-a990-41b8-b734-ed1dff057acf None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.056030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920dba1-be49-4b2b-9219-ea49f25b72e4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.060719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce34dc-5a2e-4c17-a0a8-bfaa636768a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.061334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce34dc-5a2e-4c17-a0a8-bfaa636768a1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.061620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce34dc-5a2e-4c17-a0a8-bfaa636768a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.061902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce34dc-5a2e-4c17-a0a8-bfaa636768a1 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.062633 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce34dc-5a2e-4c17-a0a8-bfaa636768a1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:08.062944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce34dc-5a2e-4c17-a0a8-bfaa636768a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.064442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce34dc-5a2e-4c17-a0a8-bfaa636768a1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.087825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 289/590] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:08.087825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce34dc-5a2e-4c17-a0a8-bfaa636768a1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:08.099188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9493bd-2493-4b33-bc98-966dcd074545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.100445 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9493bd-2493-4b33-bc98-966dcd074545 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.100861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9493bd-2493-4b33-bc98-966dcd074545 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.101142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9493bd-2493-4b33-bc98-966dcd074545 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.110838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9493bd-2493-4b33-bc98-966dcd074545 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.112009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9493bd-2493-4b33-bc98-966dcd074545 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-de9493bd-2493-4b33-bc98-966dcd074545 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:08.129134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:08.130073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 302/591] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:08.131049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9493bd-2493-4b33-bc98-966dcd074545 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:08.187882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:08.206729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce34dc-5a2e-4c17-a0a8-bfaa636768a1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.230325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:08.252035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719c904-f4ac-45dc-9240-4e53ac13f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.252799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719c904-f4ac-45dc-9240-4e53ac13f1fd None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.253184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719c904-f4ac-45dc-9240-4e53ac13f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.253582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719c904-f4ac-45dc-9240-4e53ac13f1fd None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.254322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719c904-f4ac-45dc-9240-4e53ac13f1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:08.254734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719c904-f4ac-45dc-9240-4e53ac13f1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.256255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719c904-f4ac-45dc-9240-4e53ac13f1fd None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.259076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9493bd-2493-4b33-bc98-966dcd074545 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.272094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 290/592] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:08.272094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719c904-f4ac-45dc-9240-4e53ac13f1fd None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:08.300542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe4b5-d071-44ae-9de5-f2d753bed6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.301217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe4b5-d071-44ae-9de5-f2d753bed6d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.301557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe4b5-d071-44ae-9de5-f2d753bed6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.301911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe4b5-d071-44ae-9de5-f2d753bed6d7 None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/4971acb91bbf498887606c5ba5d00176/roles/73f84507c19147c0b7e3cdf8ac72e212` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.318192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe4b5-d071-44ae-9de5-f2d753bed6d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=4971acb91bbf498887606c5ba5d00176, role_id=73f84507c19147c0b7e3cdf8ac72e212)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.319799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fe4b5-d071-44ae-9de5-f2d753bed6d7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.371344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719c904-f4ac-45dc-9240-4e53ac13f1fd None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.383662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 303/593] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:59:08 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/4971acb91bbf498887606c5ba5d00176/roles/73f84507c19147c0b7e3cdf8ac72e212 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:59:08.383662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe4b5-d071-44ae-9de5-f2d753bed6d7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:08.421095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bba735-1f54-4319-b2aa-7875eecea505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.422413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bba735-1f54-4319-b2aa-7875eecea505 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.422911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bba735-1f54-4319-b2aa-7875eecea505 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.423364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bba735-1f54-4319-b2aa-7875eecea505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.440810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bba735-1f54-4319-b2aa-7875eecea505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.442526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bba735-1f54-4319-b2aa-7875eecea505 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.446688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-16bba735-1f54-4319-b2aa-7875eecea505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:08.465514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:08.466765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:08.467901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:08.467901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:08.467901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:08.474091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 291/594] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:08.474091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bba735-1f54-4319-b2aa-7875eecea505 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:08.528928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe4b5-d071-44ae-9de5-f2d753bed6d7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.558129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:08.569879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e35c6-dcf0-4ad1-a934-2da9def521b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.572971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e35c6-dcf0-4ad1-a934-2da9def521b4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.572971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e35c6-dcf0-4ad1-a934-2da9def521b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.572971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e35c6-dcf0-4ad1-a934-2da9def521b4 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.573638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e35c6-dcf0-4ad1-a934-2da9def521b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:08.573981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e35c6-dcf0-4ad1-a934-2da9def521b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.579031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e35c6-dcf0-4ad1-a934-2da9def521b4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.604750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 304/595] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Sep 9 11:59:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:08.604750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e35c6-dcf0-4ad1-a934-2da9def521b4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:08.621958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bba735-1f54-4319-b2aa-7875eecea505 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.660673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e848496-7570-4133-9fe8-d7632eb3ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.661408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e848496-7570-4133-9fe8-d7632eb3ae28 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.661698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e848496-7570-4133-9fe8-d7632eb3ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.661978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e848496-7570-4133-9fe8-d7632eb3ae28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.670305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e848496-7570-4133-9fe8-d7632eb3ae28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.671917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e848496-7570-4133-9fe8-d7632eb3ae28 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-9e848496-7570-4133-9fe8-d7632eb3ae28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:08.685353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:08.686294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:08.687650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:08.687650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:08.687650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:08.687650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:08.687650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:08.687650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:08.687650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:08.687650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:08.687650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 292/596] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:08.688156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e848496-7570-4133-9fe8-d7632eb3ae28 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:08.728608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e35c6-dcf0-4ad1-a934-2da9def521b4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.755783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:08.769131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db8fa0-55c6-4426-889b-60a69425258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.769753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db8fa0-55c6-4426-889b-60a69425258a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.770034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db8fa0-55c6-4426-889b-60a69425258a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.770308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db8fa0-55c6-4426-889b-60a69425258a None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.770951 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db8fa0-55c6-4426-889b-60a69425258a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:08.771256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db8fa0-55c6-4426-889b-60a69425258a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.772673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db8fa0-55c6-4426-889b-60a69425258a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.785611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 305/597] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:08.786624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db8fa0-55c6-4426-889b-60a69425258a None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:08.820915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e848496-7570-4133-9fe8-d7632eb3ae28 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.837848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:08.867393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ada1c5-c4d2-4029-98d2-021e2e44b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.868086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ada1c5-c4d2-4029-98d2-021e2e44b152 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.869327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ada1c5-c4d2-4029-98d2-021e2e44b152 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.869915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ada1c5-c4d2-4029-98d2-021e2e44b152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.887308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ada1c5-c4d2-4029-98d2-021e2e44b152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.889969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ada1c5-c4d2-4029-98d2-021e2e44b152 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.906032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db8fa0-55c6-4426-889b-60a69425258a None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-87ada1c5-c4d2-4029-98d2-021e2e44b152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:08.914481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:08.917551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:08.919962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:08.919962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:08.919962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:08.919962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 293/598] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:08.919962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ada1c5-c4d2-4029-98d2-021e2e44b152 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:08.945343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695970-89e5-4281-8b76-90ba2069ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:08.946632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695970-89e5-4281-8b76-90ba2069ad44 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:08.946915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695970-89e5-4281-8b76-90ba2069ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:08.947192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695970-89e5-4281-8b76-90ba2069ad44 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:08.947939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe695970-89e5-4281-8b76-90ba2069ad44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:08.948251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe695970-89e5-4281-8b76-90ba2069ad44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:08.949773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe695970-89e5-4281-8b76-90ba2069ad44 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:08.963735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 306/599] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:08.964665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695970-89e5-4281-8b76-90ba2069ad44 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:09.031281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ada1c5-c4d2-4029-98d2-021e2e44b152 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:09.041203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:09.067893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695970-89e5-4281-8b76-90ba2069ad44 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:09.068814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852802c6-1fdb-4f95-8d26-e5c4d45402b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:09.069730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852802c6-1fdb-4f95-8d26-e5c4d45402b7 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.070239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:09.071733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852802c6-1fdb-4f95-8d26-e5c4d45402b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.072155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852802c6-1fdb-4f95-8d26-e5c4d45402b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.079663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852802c6-1fdb-4f95-8d26-e5c4d45402b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:09.081379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852802c6-1fdb-4f95-8d26-e5c4d45402b7 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-852802c6-1fdb-4f95-8d26-e5c4d45402b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:09.095453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:09.096602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:09.097614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:09.097614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:09.097614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:09.097614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:09.097614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:09.097614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:09.097614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:09.097614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:09.099216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 294/600] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:09.104699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852802c6-1fdb-4f95-8d26-e5c4d45402b7 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:09.107479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbe7ca-d6b0-420c-8110-73edcb6a3da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:09.108136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbe7ca-d6b0-420c-8110-73edcb6a3da9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.108420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbe7ca-d6b0-420c-8110-73edcb6a3da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.108693 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbe7ca-d6b0-420c-8110-73edcb6a3da9 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.109391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbe7ca-d6b0-420c-8110-73edcb6a3da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:09.109702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbe7ca-d6b0-420c-8110-73edcb6a3da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:09.113095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbe7ca-d6b0-420c-8110-73edcb6a3da9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:09.123839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 307/601] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:09.125337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbe7ca-d6b0-420c-8110-73edcb6a3da9 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:09.229067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbe7ca-d6b0-420c-8110-73edcb6a3da9 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:09.230971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852802c6-1fdb-4f95-8d26-e5c4d45402b7 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:09.264671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668b547-fb22-4191-8898-b75409c1d54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:09.265328 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668b547-fb22-4191-8898-b75409c1d54d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.265679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668b547-fb22-4191-8898-b75409c1d54d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.266022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668b547-fb22-4191-8898-b75409c1d54d None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.266798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668b547-fb22-4191-8898-b75409c1d54d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:09.267166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668b547-fb22-4191-8898-b75409c1d54d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:09.268702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668b547-fb22-4191-8898-b75409c1d54d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:09.270853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941097-e172-4644-9814-47c6ff15f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:09.271865 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941097-e172-4644-9814-47c6ff15f620 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.272318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941097-e172-4644-9814-47c6ff15f620 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.272762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941097-e172-4644-9814-47c6ff15f620 None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/decb5421872c4034bbbaa8c3cd9dcb5d/roles/73f84507c19147c0b7e3cdf8ac72e212` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.286978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 308/602] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:09.286978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668b547-fb22-4191-8898-b75409c1d54d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:09.294965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d941097-e172-4644-9814-47c6ff15f620 None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=decb5421872c4034bbbaa8c3cd9dcb5d, role_id=73f84507c19147c0b7e3cdf8ac72e212)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:09.296842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d941097-e172-4644-9814-47c6ff15f620 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:09.309947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:09.398963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668b547-fb22-4191-8898-b75409c1d54d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:09.399557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 295/603] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:59:09 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/decb5421872c4034bbbaa8c3cd9dcb5d/roles/73f84507c19147c0b7e3cdf8ac72e212 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:59:09.401873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941097-e172-4644-9814-47c6ff15f620 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:09.448714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:09.473741 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3b23d-bce8-41b1-8492-2136af80c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:09.474398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3b23d-bce8-41b1-8492-2136af80c2fd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.474683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3b23d-bce8-41b1-8492-2136af80c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.474962 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3b23d-bce8-41b1-8492-2136af80c2fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.482610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3b23d-bce8-41b1-8492-2136af80c2fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:09.484161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3b23d-bce8-41b1-8492-2136af80c2fd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-52c3b23d-bce8-41b1-8492-2136af80c2fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:09.498787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:09.501273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 309/604] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ab5df-0bfb-4307-93bb-c36c0121256b None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.502372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ab5df-0bfb-4307-93bb-c36c0121256b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.503136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ab5df-0bfb-4307-93bb-c36c0121256b None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.513415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 310/605] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:09.513415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ab5df-0bfb-4307-93bb-c36c0121256b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:09.582238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941097-e172-4644-9814-47c6ff15f620 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:09.609932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:09.626940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc580418-3507-4e31-9e19-a1aa239ce29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:09.628011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc580418-3507-4e31-9e19-a1aa239ce29c None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.628393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc580418-3507-4e31-9e19-a1aa239ce29c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.628765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc580418-3507-4e31-9e19-a1aa239ce29c None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/6ce95a25d894457d8cd45c30b38f014e/roles/73f84507c19147c0b7e3cdf8ac72e212` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.630940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ab5df-0bfb-4307-93bb-c36c0121256b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:09.645556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc580418-3507-4e31-9e19-a1aa239ce29c None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=6ce95a25d894457d8cd45c30b38f014e, role_id=73f84507c19147c0b7e3cdf8ac72e212)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:09.647851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc580418-3507-4e31-9e19-a1aa239ce29c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:09.672284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317ccf9-5426-4d0c-90e4-62a0c633fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:09.672829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317ccf9-5426-4d0c-90e4-62a0c633fc59 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.673118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317ccf9-5426-4d0c-90e4-62a0c633fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.673385 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317ccf9-5426-4d0c-90e4-62a0c633fc59 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.674074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317ccf9-5426-4d0c-90e4-62a0c633fc59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:09.674382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317ccf9-5426-4d0c-90e4-62a0c633fc59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:09.675863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317ccf9-5426-4d0c-90e4-62a0c633fc59 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:09.690005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 311/606] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:09.691366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09575b90-36c1-4fe0-851a-26cbfabbba94 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.691753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09575b90-36c1-4fe0-851a-26cbfabbba94 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.691964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09575b90-36c1-4fe0-851a-26cbfabbba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.712384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-09575b90-36c1-4fe0-851a-26cbfabbba94 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:09.713496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-09575b90-36c1-4fe0-851a-26cbfabbba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:09.741516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 296/607] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:59:09 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/6ce95a25d894457d8cd45c30b38f014e/roles/73f84507c19147c0b7e3cdf8ac72e212 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:59:09.742319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc580418-3507-4e31-9e19-a1aa239ce29c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:09.807820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 312/608] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:09.836085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:09.879007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc580418-3507-4e31-9e19-a1aa239ce29c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:09.927939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168cd3a-0377-4704-a4fc-8d1acd351823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:09.928605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168cd3a-0377-4704-a4fc-8d1acd351823 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:09.928888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168cd3a-0377-4704-a4fc-8d1acd351823 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:09.929165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168cd3a-0377-4704-a4fc-8d1acd351823 None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/88d492b570be4de4b6a6d85f6374ed31/roles/73f84507c19147c0b7e3cdf8ac72e212` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:09.953925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168cd3a-0377-4704-a4fc-8d1acd351823 None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=88d492b570be4de4b6a6d85f6374ed31, role_id=73f84507c19147c0b7e3cdf8ac72e212)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:09.955507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168cd3a-0377-4704-a4fc-8d1acd351823 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:10.052756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 297/609] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:59:09 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/88d492b570be4de4b6a6d85f6374ed31/roles/73f84507c19147c0b7e3cdf8ac72e212 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:59:10.253337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09575b90-36c1-4fe0-851a-26cbfabbba94 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:10.342924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:10.377967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09575b90-36c1-4fe0-851a-26cbfabbba94 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:10.416034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d446b07-0138-4495-813c-36b9f6decc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:10.416740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d446b07-0138-4495-813c-36b9f6decc04 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:10.417024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d446b07-0138-4495-813c-36b9f6decc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:10.417302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d446b07-0138-4495-813c-36b9f6decc04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:10.433320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d446b07-0138-4495-813c-36b9f6decc04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-3d446b07-0138-4495-813c-36b9f6decc04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:10.438598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:10.439537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:10.440410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 313/610] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:10.445920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168cd3a-0377-4704-a4fc-8d1acd351823 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:10.554487 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168cd3a-0377-4704-a4fc-8d1acd351823 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:10.580106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:10.596688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018a74-3c6c-49b0-b82c-fcc629b52c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:10.597351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018a74-3c6c-49b0-b82c-fcc629b52c84 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:10.597638 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018a74-3c6c-49b0-b82c-fcc629b52c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:10.598318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018a74-3c6c-49b0-b82c-fcc629b52c84 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:10.598597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018a74-3c6c-49b0-b82c-fcc629b52c84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:10.598905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018a74-3c6c-49b0-b82c-fcc629b52c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:10.600308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018a74-3c6c-49b0-b82c-fcc629b52c84 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:10.613989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 298/611] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:10.620479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d446b07-0138-4495-813c-36b9f6decc04 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:10.758534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d446b07-0138-4495-813c-36b9f6decc04 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:10.803400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc18102-a2fc-4326-be30-38a97ec800fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:10.804065 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc18102-a2fc-4326-be30-38a97ec800fc None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:10.804347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc18102-a2fc-4326-be30-38a97ec800fc None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:10.804680 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc18102-a2fc-4326-be30-38a97ec800fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:10.809587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:10.818585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc18102-a2fc-4326-be30-38a97ec800fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:10.820088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc18102-a2fc-4326-be30-38a97ec800fc None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-8bc18102-a2fc-4326-be30-38a97ec800fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:10.845392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:10.846413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:10.847309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:10.847309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:10.847309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:10.848955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 314/612] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:10.855271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018a74-3c6c-49b0-b82c-fcc629b52c84 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:10.967957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018a74-3c6c-49b0-b82c-fcc629b52c84 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:11.010111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39444882-0714-4e83-bcf1-2c0d61d6b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:11.010734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39444882-0714-4e83-bcf1-2c0d61d6b02b None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:11.011019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39444882-0714-4e83-bcf1-2c0d61d6b02b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:11.011353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39444882-0714-4e83-bcf1-2c0d61d6b02b None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:11.012028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39444882-0714-4e83-bcf1-2c0d61d6b02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:11.012335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39444882-0714-4e83-bcf1-2c0d61d6b02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:11.013708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39444882-0714-4e83-bcf1-2c0d61d6b02b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:11.027758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 299/613] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:11.032919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc18102-a2fc-4326-be30-38a97ec800fc None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:11.045555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf38fa-f636-46b5-b8e4-b97d8d5476c7 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:11.046608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf38fa-f636-46b5-b8e4-b97d8d5476c7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:11.047139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf38fa-f636-46b5-b8e4-b97d8d5476c7 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:11.048946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 300/614] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:11.055441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573361eb-52e8-47fb-9ab7-82c0558baec6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:11.056126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573361eb-52e8-47fb-9ab7-82c0558baec6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:11.056630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573361eb-52e8-47fb-9ab7-82c0558baec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:11.093826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-573361eb-52e8-47fb-9ab7-82c0558baec6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:11.095382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-573361eb-52e8-47fb-9ab7-82c0558baec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:11.185313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:11.194158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc18102-a2fc-4326-be30-38a97ec800fc None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:11.232973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92c998-922e-4d49-a944-a99a26741a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:11.234338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92c998-922e-4d49-a944-a99a26741a22 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:11.234828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92c998-922e-4d49-a944-a99a26741a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:11.235304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92c998-922e-4d49-a944-a99a26741a22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:11.244166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92c998-922e-4d49-a944-a99a26741a22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:11.246131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92c998-922e-4d49-a944-a99a26741a22 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-8e92c998-922e-4d49-a944-a99a26741a22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:11.259871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:11.261274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:11.262224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:11.265033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 315/615] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:11.270616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92c998-922e-4d49-a944-a99a26741a22 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:11.288002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 301/616] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:59:11.341917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:11.400022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92c998-922e-4d49-a944-a99a26741a22 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:11.439542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cb15-f673-4ad0-afff-7e4e03d3d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:11.440544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cb15-f673-4ad0-afff-7e4e03d3d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:11.441034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cb15-f673-4ad0-afff-7e4e03d3d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:11.441552 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cb15-f673-4ad0-afff-7e4e03d3d5e8 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:11.442493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07cb15-f673-4ad0-afff-7e4e03d3d5e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:11.443014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07cb15-f673-4ad0-afff-7e4e03d3d5e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:11.444682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07cb15-f673-4ad0-afff-7e4e03d3d5e8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:11.464787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 316/617] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 11:59:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:11.472760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573361eb-52e8-47fb-9ab7-82c0558baec6 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:11.583824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573361eb-52e8-47fb-9ab7-82c0558baec6 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:11.647382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08bdab-09d0-495a-a33d-f1e3c2cfd256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:11.647382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08bdab-09d0-495a-a33d-f1e3c2cfd256 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:11.647382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08bdab-09d0-495a-a33d-f1e3c2cfd256 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:11.647382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08bdab-09d0-495a-a33d-f1e3c2cfd256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:11.647934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cb15-f673-4ad0-afff-7e4e03d3d5e8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:11.649084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08bdab-09d0-495a-a33d-f1e3c2cfd256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:11.650602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08bdab-09d0-495a-a33d-f1e3c2cfd256 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-8b08bdab-09d0-495a-a33d-f1e3c2cfd256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:11.686688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:11.687891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:11.689002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:11.689002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:11.689002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:11.689002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 302/618] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:11.693726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08bdab-09d0-495a-a33d-f1e3c2cfd256 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:11.754275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:11.842387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cb15-f673-4ad0-afff-7e4e03d3d5e8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:11.847944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:11.922911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af457-d1b1-4c29-ba4b-8a770034d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:11.923478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af457-d1b1-4c29-ba4b-8a770034d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:11.923791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af457-d1b1-4c29-ba4b-8a770034d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:11.924873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08bdab-09d0-495a-a33d-f1e3c2cfd256 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:11.926492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af457-d1b1-4c29-ba4b-8a770034d2b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:11.950466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0af457-d1b1-4c29-ba4b-8a770034d2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-6c0af457-d1b1-4c29-ba4b-8a770034d2b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:11.955270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:11.956245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:11.957099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:11.964987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 317/619] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:11.965935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af457-d1b1-4c29-ba4b-8a770034d2b9 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:12.000947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02918e7d-b42b-4446-9a04-b37c658d0cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:12.001571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02918e7d-b42b-4446-9a04-b37c658d0cac None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.001855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02918e7d-b42b-4446-9a04-b37c658d0cac None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.002134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02918e7d-b42b-4446-9a04-b37c658d0cac None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.002786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02918e7d-b42b-4446-9a04-b37c658d0cac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:12.003093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02918e7d-b42b-4446-9a04-b37c658d0cac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:12.004787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02918e7d-b42b-4446-9a04-b37c658d0cac None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:12.019328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 303/620] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:12.020934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a1f2-33c2-4336-972b-5e2c991c786a None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.021205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a1f2-33c2-4336-972b-5e2c991c786a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.021487 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a1f2-33c2-4336-972b-5e2c991c786a None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.023119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 304/621] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:12.024470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047a1f2-33c2-4336-972b-5e2c991c786a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:12.128159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:12.130721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af457-d1b1-4c29-ba4b-8a770034d2b9 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:12.151226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047a1f2-33c2-4336-972b-5e2c991c786a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:12.169822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e71173-49b2-4932-98d1-5cda1375ec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:12.170882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e71173-49b2-4932-98d1-5cda1375ec0b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.171383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e71173-49b2-4932-98d1-5cda1375ec0b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.171961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e71173-49b2-4932-98d1-5cda1375ec0b None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.173007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e71173-49b2-4932-98d1-5cda1375ec0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:12.173682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e71173-49b2-4932-98d1-5cda1375ec0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:12.175255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e71173-49b2-4932-98d1-5cda1375ec0b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:12.185642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 318/622] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:12.187364 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39ffa3-bdb0-41e3-a530-8fb32e30ce39 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.187932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39ffa3-bdb0-41e3-a530-8fb32e30ce39 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.188440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39ffa3-bdb0-41e3-a530-8fb32e30ce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.192636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee784db-e93e-4a3a-a270-a37638b5aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:12.193376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee784db-e93e-4a3a-a270-a37638b5aedc None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.193658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee784db-e93e-4a3a-a270-a37638b5aedc None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.193948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee784db-e93e-4a3a-a270-a37638b5aedc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.202176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee784db-e93e-4a3a-a270-a37638b5aedc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:12.203656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee784db-e93e-4a3a-a270-a37638b5aedc None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:12.210397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2b39ffa3-bdb0-41e3-a530-8fb32e30ce39 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:12.212017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2b39ffa3-bdb0-41e3-a530-8fb32e30ce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-fee784db-e93e-4a3a-a270-a37638b5aedc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:12.216869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:12.217807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:12.218700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:12.218700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:12.218700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:12.218700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:12.218700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:12.218700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:12.218700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:12.218700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:12.220601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 305/623] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:12.222078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee784db-e93e-4a3a-a270-a37638b5aedc None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:12.236226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:12.296892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 319/624] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:12.299163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39ffa3-bdb0-41e3-a530-8fb32e30ce39 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:12.340707 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee784db-e93e-4a3a-a270-a37638b5aedc None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:12.410253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d819-d7a7-4dac-8bda-7717b6851786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:12.413127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d819-d7a7-4dac-8bda-7717b6851786 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.413429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d819-d7a7-4dac-8bda-7717b6851786 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.413705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d819-d7a7-4dac-8bda-7717b6851786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.433859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0d819-d7a7-4dac-8bda-7717b6851786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:12.435244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0d819-d7a7-4dac-8bda-7717b6851786 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:12.440197 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:12.454536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39ffa3-bdb0-41e3-a530-8fb32e30ce39 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-57d0d819-d7a7-4dac-8bda-7717b6851786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:12.471660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:12.472700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:12.473639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:12.473639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:12.473639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:12.475656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 306/625] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:12.479949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d819-d7a7-4dac-8bda-7717b6851786 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:12.525070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eb9bf-9995-4574-9634-96cfc008c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:12.525649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eb9bf-9995-4574-9634-96cfc008c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.525950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eb9bf-9995-4574-9634-96cfc008c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.526205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eb9bf-9995-4574-9634-96cfc008c6a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.527025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eb9bf-9995-4574-9634-96cfc008c6a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:12.527511 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eb9bf-9995-4574-9634-96cfc008c6a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:12.529084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eb9bf-9995-4574-9634-96cfc008c6a5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:12.543231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 320/626] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:12.544498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b248-4614-4084-9ac2-c26c63064b46 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.544782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b248-4614-4084-9ac2-c26c63064b46 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.545055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b248-4614-4084-9ac2-c26c63064b46 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.546488 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 321/627] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:12.548440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09b248-4614-4084-9ac2-c26c63064b46 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:12.568393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:12.614283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d819-d7a7-4dac-8bda-7717b6851786 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:12.651323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3916001-2756-420d-b5aa-aadcc16bd840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:12.651967 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3916001-2756-420d-b5aa-aadcc16bd840 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.652253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3916001-2756-420d-b5aa-aadcc16bd840 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.652539 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3916001-2756-420d-b5aa-aadcc16bd840 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.653179 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3916001-2756-420d-b5aa-aadcc16bd840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:12.653492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3916001-2756-420d-b5aa-aadcc16bd840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:12.654860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3916001-2756-420d-b5aa-aadcc16bd840 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:12.662827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09b248-4614-4084-9ac2-c26c63064b46 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:12.672170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 307/628] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:12.672170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b1571-e933-4dc4-a2ae-e9fdb49ff044 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.672170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b1571-e933-4dc4-a2ae-e9fdb49ff044 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.672536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b1571-e933-4dc4-a2ae-e9fdb49ff044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.693486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6c4b1571-e933-4dc4-a2ae-e9fdb49ff044 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:12.697141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6c4b1571-e933-4dc4-a2ae-e9fdb49ff044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:12.713008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09600c62-550f-473b-96ab-007378da1ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:12.714176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09600c62-550f-473b-96ab-007378da1ddd None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.714457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09600c62-550f-473b-96ab-007378da1ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.714728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09600c62-550f-473b-96ab-007378da1ddd None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/063f7bf74f444c14b9bf6c0ca936dd12/roles/73f84507c19147c0b7e3cdf8ac72e212` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.731955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09600c62-550f-473b-96ab-007378da1ddd None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=063f7bf74f444c14b9bf6c0ca936dd12, role_id=73f84507c19147c0b7e3cdf8ac72e212)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:12.733385 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09600c62-550f-473b-96ab-007378da1ddd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:12.761751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:12.779093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 308/629] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:12.779959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b1571-e933-4dc4-a2ae-e9fdb49ff044 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:12.854521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 322/630] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:59:12 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/063f7bf74f444c14b9bf6c0ca936dd12/roles/73f84507c19147c0b7e3cdf8ac72e212 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:59:12.855965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09600c62-550f-473b-96ab-007378da1ddd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:12.890875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b1571-e933-4dc4-a2ae-e9fdb49ff044 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:12.941712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be0fd0-fd25-45ef-9b85-9383844aac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:12.942406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0fd0-fd25-45ef-9b85-9383844aac3d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.942651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0fd0-fd25-45ef-9b85-9383844aac3d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.943102 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0fd0-fd25-45ef-9b85-9383844aac3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.944382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:12.959562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be0fd0-fd25-45ef-9b85-9383844aac3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-38be0fd0-fd25-45ef-9b85-9383844aac3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:12.967079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:12.968384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:12.969242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:12.969884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 309/631] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:12.970802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e8fdc-efef-48eb-bbed-727d8ccc2358 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:12.971093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e8fdc-efef-48eb-bbed-727d8ccc2358 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:12.971570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e8fdc-efef-48eb-bbed-727d8ccc2358 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:12.973366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 310/632] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:12.975452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e8fdc-efef-48eb-bbed-727d8ccc2358 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:13.000620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09600c62-550f-473b-96ab-007378da1ddd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:13.045391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:13.047857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e54c1-bcb6-4137-8b44-4ce1ff1edcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:13.048696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e54c1-bcb6-4137-8b44-4ce1ff1edcba None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.049282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e54c1-bcb6-4137-8b44-4ce1ff1edcba None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.049282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e54c1-bcb6-4137-8b44-4ce1ff1edcba None admin] PATH_INFO: `/v3/users/nova` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.060461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e54c1-bcb6-4137-8b44-4ce1ff1edcba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:13.061797 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e54c1-bcb6-4137-8b44-4ce1ff1edcba None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-461e54c1-bcb6-4137-8b44-4ce1ff1edcba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:13.075204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:13.076231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:13.077199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 323/633] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 11:59:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:13.079032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af1d0-d231-491b-b885-65df33de398c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.079032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af1d0-d231-491b-b885-65df33de398c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.079032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4af1d0-d231-491b-b885-65df33de398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.096375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2d4af1d0-d231-491b-b885-65df33de398c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:13.097566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2d4af1d0-d231-491b-b885-65df33de398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:13.114566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e8fdc-efef-48eb-bbed-727d8ccc2358 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:13.150112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6f683-caab-4689-9012-7bb16a79d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:13.150594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6f683-caab-4689-9012-7bb16a79d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.150877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6f683-caab-4689-9012-7bb16a79d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.151148 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6f683-caab-4689-9012-7bb16a79d3f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.151897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6f683-caab-4689-9012-7bb16a79d3f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:13.152205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6f683-caab-4689-9012-7bb16a79d3f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:13.153580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6f683-caab-4689-9012-7bb16a79d3f6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:13.161591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 311/634] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:13.161591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6f683-caab-4689-9012-7bb16a79d3f6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:13.184670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 324/635] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:13.185466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4af1d0-d231-491b-b885-65df33de398c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:13.244720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:13.291486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4af1d0-d231-491b-b885-65df33de398c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:13.304764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6f683-caab-4689-9012-7bb16a79d3f6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:13.314561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:13.330124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49895fba-2fd5-44ad-ba02-04814c0f7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:13.330747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49895fba-2fd5-44ad-ba02-04814c0f7c4f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.331188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49895fba-2fd5-44ad-ba02-04814c0f7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.331539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49895fba-2fd5-44ad-ba02-04814c0f7c4f None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.332430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49895fba-2fd5-44ad-ba02-04814c0f7c4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:13.333104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49895fba-2fd5-44ad-ba02-04814c0f7c4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:13.334450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49895fba-2fd5-44ad-ba02-04814c0f7c4f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:13.350031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ecc5d-4912-4e20-a952-1c23c3b907e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:13.350982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ecc5d-4912-4e20-a952-1c23c3b907e8 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.351446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ecc5d-4912-4e20-a952-1c23c3b907e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.351932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ecc5d-4912-4e20-a952-1c23c3b907e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.360577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 325/636] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 11:59:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:13.360577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49895fba-2fd5-44ad-ba02-04814c0f7c4f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:13.371243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ecc5d-4912-4e20-a952-1c23c3b907e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-0c4ecc5d-4912-4e20-a952-1c23c3b907e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:13.378091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:13.379034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:13.379890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:13.382406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 312/637] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:13.382406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ecc5d-4912-4e20-a952-1c23c3b907e8 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:13.488467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49895fba-2fd5-44ad-ba02-04814c0f7c4f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:13.502927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ecc5d-4912-4e20-a952-1c23c3b907e8 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:13.504010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:13.524937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b8441-41ba-4a30-8fb2-609943a13670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:13.525560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b8441-41ba-4a30-8fb2-609943a13670 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.525836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b8441-41ba-4a30-8fb2-609943a13670 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.526108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b8441-41ba-4a30-8fb2-609943a13670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.540530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994805-232c-478e-9e1c-dc83beec6ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:13.541164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994805-232c-478e-9e1c-dc83beec6ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.541439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994805-232c-478e-9e1c-dc83beec6ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.541717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994805-232c-478e-9e1c-dc83beec6ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.545578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b8441-41ba-4a30-8fb2-609943a13670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:13.547234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b8441-41ba-4a30-8fb2-609943a13670 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-422b8441-41ba-4a30-8fb2-609943a13670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:13.563072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:13.564128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:13.565031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:13.565031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:13.565031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:13.567748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 326/638] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:13.568794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b8441-41ba-4a30-8fb2-609943a13670 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:13.581589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:13.618577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7994805-232c-478e-9e1c-dc83beec6ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:13.620399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7994805-232c-478e-9e1c-dc83beec6ed0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:13.675413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b8441-41ba-4a30-8fb2-609943a13670 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:13.712881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39dcb-9823-4be6-a2e0-8be651e295ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:13.713501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39dcb-9823-4be6-a2e0-8be651e295ed None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.713782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39dcb-9823-4be6-a2e0-8be651e295ed None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.714058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39dcb-9823-4be6-a2e0-8be651e295ed None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.714726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39dcb-9823-4be6-a2e0-8be651e295ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:13.715061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39dcb-9823-4be6-a2e0-8be651e295ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:13.716462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39dcb-9823-4be6-a2e0-8be651e295ed None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:13.729795 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 327/639] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:13.730935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39dcb-9823-4be6-a2e0-8be651e295ed None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:13.732210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 313/640] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:13.733201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994805-232c-478e-9e1c-dc83beec6ed0 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:13.766098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:13.809170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:13.843877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994805-232c-478e-9e1c-dc83beec6ed0 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:13.848083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39dcb-9823-4be6-a2e0-8be651e295ed None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:13.882333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ce998-ed41-457f-83bf-8e96db63d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:13.882945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ce998-ed41-457f-83bf-8e96db63d315 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.883240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ce998-ed41-457f-83bf-8e96db63d315 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.883496 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ce998-ed41-457f-83bf-8e96db63d315 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.884161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ce998-ed41-457f-83bf-8e96db63d315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:13.884467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ce998-ed41-457f-83bf-8e96db63d315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:13.884825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da461ab-e225-4d93-8e4a-854a3819abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:13.885418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da461ab-e225-4d93-8e4a-854a3819abf6 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:13.885699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da461ab-e225-4d93-8e4a-854a3819abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:13.885854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ce998-ed41-457f-83bf-8e96db63d315 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:13.885958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da461ab-e225-4d93-8e4a-854a3819abf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:13.896538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da461ab-e225-4d93-8e4a-854a3819abf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:13.897625 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 314/641] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:13.898433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ce998-ed41-457f-83bf-8e96db63d315 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0da461ab-e225-4d93-8e4a-854a3819abf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:13.903534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:13.904610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 328/642] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:13.906027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da461ab-e225-4d93-8e4a-854a3819abf6 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.002768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:14.008696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ce998-ed41-457f-83bf-8e96db63d315 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.016389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da461ab-e225-4d93-8e4a-854a3819abf6 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.039173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:14.048316 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e176d6b-62c0-4e24-ae4c-be4bc4de1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.048960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e176d6b-62c0-4e24-ae4c-be4bc4de1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.049238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e176d6b-62c0-4e24-ae4c-be4bc4de1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.049513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e176d6b-62c0-4e24-ae4c-be4bc4de1cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.060306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e176d6b-62c0-4e24-ae4c-be4bc4de1cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.061753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e176d6b-62c0-4e24-ae4c-be4bc4de1cc0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.065603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9ff0e-7324-4b64-99c6-9ce5d0c1448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.066236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9ff0e-7324-4b64-99c6-9ce5d0c1448f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.066519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9ff0e-7324-4b64-99c6-9ce5d0c1448f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.066794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9ff0e-7324-4b64-99c6-9ce5d0c1448f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-9e176d6b-62c0-4e24-ae4c-be4bc4de1cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:14.076402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:14.077429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:14.078375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:14.078375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:14.078375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:14.078557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9ff0e-7324-4b64-99c6-9ce5d0c1448f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.078644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 315/643] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:14.079203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e176d6b-62c0-4e24-ae4c-be4bc4de1cc0 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.080654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9ff0e-7324-4b64-99c6-9ce5d0c1448f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-52d9ff0e-7324-4b64-99c6-9ce5d0c1448f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:14.098561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:14.099772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:14.100851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:14.100851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:14.100851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:14.100851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 329/644] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:14.100851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9ff0e-7324-4b64-99c6-9ce5d0c1448f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.202821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e176d6b-62c0-4e24-ae4c-be4bc4de1cc0 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.212986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9ff0e-7324-4b64-99c6-9ce5d0c1448f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.238854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cab57-b123-49e6-9ec4-9340d1bc26bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.239766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cab57-b123-49e6-9ec4-9340d1bc26bc None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.240186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cab57-b123-49e6-9ec4-9340d1bc26bc None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.240743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cab57-b123-49e6-9ec4-9340d1bc26bc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.248998 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93654f4a-36af-42d4-aba7-edc153f2150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.249398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cab57-b123-49e6-9ec4-9340d1bc26bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.249609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93654f4a-36af-42d4-aba7-edc153f2150c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.250155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93654f4a-36af-42d4-aba7-edc153f2150c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.250435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93654f4a-36af-42d4-aba7-edc153f2150c None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.251103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93654f4a-36af-42d4-aba7-edc153f2150c None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:14.251411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93654f4a-36af-42d4-aba7-edc153f2150c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.252084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cab57-b123-49e6-9ec4-9340d1bc26bc None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.252831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93654f4a-36af-42d4-aba7-edc153f2150c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.261371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 330/645] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:14.262176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93654f4a-36af-42d4-aba7-edc153f2150c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-053cab57-b123-49e6-9ec4-9340d1bc26bc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:14.265329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:14.266320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:59:14.267522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:14.270688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:14.271256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 316/646] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:14.272330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cab57-b123-49e6-9ec4-9340d1bc26bc None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.316077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:14.379002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93654f4a-36af-42d4-aba7-edc153f2150c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.385090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cab57-b123-49e6-9ec4-9340d1bc26bc None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.417085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d0393-9455-4963-b226-189d4a6ee923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.417838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0393-9455-4963-b226-189d4a6ee923 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.418127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0393-9455-4963-b226-189d4a6ee923 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.418444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0393-9455-4963-b226-189d4a6ee923 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.419156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d0393-9455-4963-b226-189d4a6ee923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:14.419390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d0393-9455-4963-b226-189d4a6ee923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.420802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d0393-9455-4963-b226-189d4a6ee923 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.422521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcddd7-6f28-46ea-b394-37b4af504f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.423144 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcddd7-6f28-46ea-b394-37b4af504f86 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.423425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcddd7-6f28-46ea-b394-37b4af504f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.423742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcddd7-6f28-46ea-b394-37b4af504f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.424392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcddd7-6f28-46ea-b394-37b4af504f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:14.424698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcddd7-6f28-46ea-b394-37b4af504f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.426063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcddd7-6f28-46ea-b394-37b4af504f86 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.442912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 317/647] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:14.442912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcddd7-6f28-46ea-b394-37b4af504f86 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.443188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 331/648] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:14.443188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d0393-9455-4963-b226-189d4a6ee923 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.507877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:14.547556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:14.550741 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d0393-9455-4963-b226-189d4a6ee923 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.551243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcddd7-6f28-46ea-b394-37b4af504f86 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.587116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfe67d-0da8-4da3-a99a-4bc8371ffbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.587976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfe67d-0da8-4da3-a99a-4bc8371ffbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.588341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfe67d-0da8-4da3-a99a-4bc8371ffbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.588715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfe67d-0da8-4da3-a99a-4bc8371ffbc8 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.589545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfe67d-0da8-4da3-a99a-4bc8371ffbc8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:14.589847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0abd86-3e93-4737-9a99-a61dd47f180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.590051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfe67d-0da8-4da3-a99a-4bc8371ffbc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.590477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abd86-3e93-4737-9a99-a61dd47f180d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.590792 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abd86-3e93-4737-9a99-a61dd47f180d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.591077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0abd86-3e93-4737-9a99-a61dd47f180d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.591876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfe67d-0da8-4da3-a99a-4bc8371ffbc8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.604039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0abd86-3e93-4737-9a99-a61dd47f180d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.605465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0abd86-3e93-4737-9a99-a61dd47f180d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.609236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 332/649] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:14.610161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfe67d-0da8-4da3-a99a-4bc8371ffbc8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-ae0abd86-3e93-4737-9a99-a61dd47f180d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:14.629799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:14.630981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:14.631905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:14.631905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:14.631905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:14.631905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 318/650] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:14.631905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0abd86-3e93-4737-9a99-a61dd47f180d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.727793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfe67d-0da8-4da3-a99a-4bc8371ffbc8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.739584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0abd86-3e93-4737-9a99-a61dd47f180d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.749255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:14.765228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c793d-987b-4b10-af20-80798a5256c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.766891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c793d-987b-4b10-af20-80798a5256c8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.766891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c793d-987b-4b10-af20-80798a5256c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.766891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c793d-987b-4b10-af20-80798a5256c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.773514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c793d-987b-4b10-af20-80798a5256c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.775004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c793d-987b-4b10-af20-80798a5256c8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.778746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ea00a-6763-4137-a393-4bf7000eff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.779646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ea00a-6763-4137-a393-4bf7000eff5f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.780140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ea00a-6763-4137-a393-4bf7000eff5f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.780632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ea00a-6763-4137-a393-4bf7000eff5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-099c793d-987b-4b10-af20-80798a5256c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:14.786565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:14.787496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 333/651] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:14.788469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c793d-987b-4b10-af20-80798a5256c8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.791451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ea00a-6763-4137-a393-4bf7000eff5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.793023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ea00a-6763-4137-a393-4bf7000eff5f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-5f1ea00a-6763-4137-a393-4bf7000eff5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:14.806547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:14.807615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:14.808805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:14.808805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:14.808805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:14.808805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:14.808805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:14.808805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:14.808805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:14.808805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:14.813800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 319/652] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:14.813800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ea00a-6763-4137-a393-4bf7000eff5f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:14.824211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:14.907321 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c793d-987b-4b10-af20-80798a5256c8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.922227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ea00a-6763-4137-a393-4bf7000eff5f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:14.942592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93e93-5244-455f-bc1e-557bf26471ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.943225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93e93-5244-455f-bc1e-557bf26471ab None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.943510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93e93-5244-455f-bc1e-557bf26471ab None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.943814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93e93-5244-455f-bc1e-557bf26471ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.960546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f1b4b-7b87-4d86-a586-55372f72b57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:14.961454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1b4b-7b87-4d86-a586-55372f72b57b None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:14.962158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1b4b-7b87-4d86-a586-55372f72b57b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:14.962411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1b4b-7b87-4d86-a586-55372f72b57b None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:14.963081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f1b4b-7b87-4d86-a586-55372f72b57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:14.963389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f1b4b-7b87-4d86-a586-55372f72b57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:14.964856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f1b4b-7b87-4d86-a586-55372f72b57b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:14.982064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 320/653] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:14.982064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f1b4b-7b87-4d86-a586-55372f72b57b None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:15.005366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:15.025748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c93e93-5244-455f-bc1e-557bf26471ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:15.027186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c93e93-5244-455f-bc1e-557bf26471ab None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:15.063043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:15.094694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f1b4b-7b87-4d86-a586-55372f72b57b None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:15.129270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 334/654] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:15.130187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93e93-5244-455f-bc1e-557bf26471ab None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:15.130703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f18b1-1eec-48fd-b8a0-14f9dc2c363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:15.131318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f18b1-1eec-48fd-b8a0-14f9dc2c363a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.131601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f18b1-1eec-48fd-b8a0-14f9dc2c363a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.131910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f18b1-1eec-48fd-b8a0-14f9dc2c363a None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.132641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f18b1-1eec-48fd-b8a0-14f9dc2c363a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:15.132946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f18b1-1eec-48fd-b8a0-14f9dc2c363a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:15.135019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f18b1-1eec-48fd-b8a0-14f9dc2c363a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:15.152816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 321/655] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 11:59:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:15.153644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f18b1-1eec-48fd-b8a0-14f9dc2c363a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:15.213845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:15.233023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93e93-5244-455f-bc1e-557bf26471ab None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:15.252407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f18b1-1eec-48fd-b8a0-14f9dc2c363a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:15.267599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df152ced-ecc9-439a-9e7c-2c263e910bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:15.268241 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152ced-ecc9-439a-9e7c-2c263e910bfe None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.268524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152ced-ecc9-439a-9e7c-2c263e910bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.268797 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152ced-ecc9-439a-9e7c-2c263e910bfe None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.269482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df152ced-ecc9-439a-9e7c-2c263e910bfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:15.269785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df152ced-ecc9-439a-9e7c-2c263e910bfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:15.271205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df152ced-ecc9-439a-9e7c-2c263e910bfe None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:15.278194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:15.282902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 335/656] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:15.284131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9f9b6-ba49-40e9-8449-7c630b3e09f3 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.284422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9f9b6-ba49-40e9-8449-7c630b3e09f3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.284702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9f9b6-ba49-40e9-8449-7c630b3e09f3 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.286086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 336/657] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:15.286598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9f9b6-ba49-40e9-8449-7c630b3e09f3 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:15.299046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a21e6-b8d1-4515-964a-e16ef2ed1117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:15.299046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a21e6-b8d1-4515-964a-e16ef2ed1117 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.299046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a21e6-b8d1-4515-964a-e16ef2ed1117 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.299046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a21e6-b8d1-4515-964a-e16ef2ed1117 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.300515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a21e6-b8d1-4515-964a-e16ef2ed1117 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:15.301957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a21e6-b8d1-4515-964a-e16ef2ed1117 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4e9a21e6-b8d1-4515-964a-e16ef2ed1117 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:15.313419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:15.314533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 322/658] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:15.315859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a21e6-b8d1-4515-964a-e16ef2ed1117 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:15.395490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9f9b6-ba49-40e9-8449-7c630b3e09f3 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:15.415599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a21e6-b8d1-4515-964a-e16ef2ed1117 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:15.428750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38881b-eee9-4dbc-b8e4-6d96c56e2b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:15.429378 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38881b-eee9-4dbc-b8e4-6d96c56e2b9f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.429656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38881b-eee9-4dbc-b8e4-6d96c56e2b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.429928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38881b-eee9-4dbc-b8e4-6d96c56e2b9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.442591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:15.445528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38881b-eee9-4dbc-b8e4-6d96c56e2b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:15.446977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38881b-eee9-4dbc-b8e4-6d96c56e2b9f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:15.449091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2d00-7b39-4b80-8652-f8a92b60075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:15.449708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2d00-7b39-4b80-8652-f8a92b60075d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.449988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2d00-7b39-4b80-8652-f8a92b60075d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.450273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2d00-7b39-4b80-8652-f8a92b60075d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-2b38881b-eee9-4dbc-b8e4-6d96c56e2b9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:15.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:15.462813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:15.463850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:15.463850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:15.463850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:15.463850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 337/659] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:15.463850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38881b-eee9-4dbc-b8e4-6d96c56e2b9f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:15.508138 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:15.525120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f2d00-7b39-4b80-8652-f8a92b60075d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:15.526669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f2d00-7b39-4b80-8652-f8a92b60075d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:15.585313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38881b-eee9-4dbc-b8e4-6d96c56e2b9f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:15.622872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec6d69-2536-47b0-a1ff-c7fa6572ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:15.623493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec6d69-2536-47b0-a1ff-c7fa6572ab26 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.623807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec6d69-2536-47b0-a1ff-c7fa6572ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.624088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec6d69-2536-47b0-a1ff-c7fa6572ab26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.624826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec6d69-2536-47b0-a1ff-c7fa6572ab26 None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=4971acb91bbf498887606c5ba5d00176) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:15.625405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec6d69-2536-47b0-a1ff-c7fa6572ab26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:15.626852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec6d69-2536-47b0-a1ff-c7fa6572ab26 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:15.634098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 338/660] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:15 2022] GET /identity/v3/role_assignments?user.id=4971acb91bbf498887606c5ba5d00176&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:15.635139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36415a5-61e1-48cf-b29c-fc5aa914b116 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.635412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36415a5-61e1-48cf-b29c-fc5aa914b116 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.635768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36415a5-61e1-48cf-b29c-fc5aa914b116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.660664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b36415a5-61e1-48cf-b29c-fc5aa914b116 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:15.662397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b36415a5-61e1-48cf-b29c-fc5aa914b116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:15.669842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 323/661] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:15.669842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2d00-7b39-4b80-8652-f8a92b60075d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:15.729390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:15.747143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 339/662] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:15.748714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36415a5-61e1-48cf-b29c-fc5aa914b116 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:15.792903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:15.810198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2d00-7b39-4b80-8652-f8a92b60075d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:15.853796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e11a02-5736-439c-974a-d080cd748eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:15.854333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e11a02-5736-439c-974a-d080cd748eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.854613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e11a02-5736-439c-974a-d080cd748eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.854886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e11a02-5736-439c-974a-d080cd748eb3 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.855612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e11a02-5736-439c-974a-d080cd748eb3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:15.856010 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e11a02-5736-439c-974a-d080cd748eb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:15.857437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e11a02-5736-439c-974a-d080cd748eb3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:15.879536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36415a5-61e1-48cf-b29c-fc5aa914b116 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:15.879751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 324/663] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Sep 9 11:59:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:15.880536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e11a02-5736-439c-974a-d080cd748eb3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:15.930494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33a267-2506-4bfb-a223-b5c14a48b3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:15.932811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33a267-2506-4bfb-a223-b5c14a48b3cb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:15.932811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33a267-2506-4bfb-a223-b5c14a48b3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:15.932811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33a267-2506-4bfb-a223-b5c14a48b3cb None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:15.932811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33a267-2506-4bfb-a223-b5c14a48b3cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:15.933110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33a267-2506-4bfb-a223-b5c14a48b3cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:15.935156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33a267-2506-4bfb-a223-b5c14a48b3cb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:15.949571 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 340/664] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:15.950425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33a267-2506-4bfb-a223-b5c14a48b3cb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.002228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e11a02-5736-439c-974a-d080cd748eb3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.007838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:16.048627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca1ed3-1b4c-4d47-a9b8-9cca9e39af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.049312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1ed3-1b4c-4d47-a9b8-9cca9e39af4d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.049766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1ed3-1b4c-4d47-a9b8-9cca9e39af4d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.050044 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1ed3-1b4c-4d47-a9b8-9cca9e39af4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.061886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca1ed3-1b4c-4d47-a9b8-9cca9e39af4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:16.063690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca1ed3-1b4c-4d47-a9b8-9cca9e39af4d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:16.071853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:16.072021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33a267-2506-4bfb-a223-b5c14a48b3cb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-82ca1ed3-1b4c-4d47-a9b8-9cca9e39af4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:16.080850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:16.085020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:16.085908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:16.085908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:16.085908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:16.085908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 325/665] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:16.085908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca1ed3-1b4c-4d47-a9b8-9cca9e39af4d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.117332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab2ce-4ecb-4baf-9865-25cb24c11836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.118431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab2ce-4ecb-4baf-9865-25cb24c11836 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.118710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab2ce-4ecb-4baf-9865-25cb24c11836 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.118983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab2ce-4ecb-4baf-9865-25cb24c11836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.194432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca1ed3-1b4c-4d47-a9b8-9cca9e39af4d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.198477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ab2ce-4ecb-4baf-9865-25cb24c11836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:16.199991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ab2ce-4ecb-4baf-9865-25cb24c11836 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:16.229603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba58608-a631-4eed-938b-c14e753ebe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.230245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba58608-a631-4eed-938b-c14e753ebe4c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.230620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba58608-a631-4eed-938b-c14e753ebe4c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.230870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba58608-a631-4eed-938b-c14e753ebe4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.238068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba58608-a631-4eed-938b-c14e753ebe4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:16.239518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba58608-a631-4eed-938b-c14e753ebe4c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-7ba58608-a631-4eed-938b-c14e753ebe4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:16.252000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:16.252927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:16.253807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:16.253807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:16.253807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:16.253807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:16.253807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:16.253807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:16.253807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:16.253807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:16.253807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 326/666] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:16.254657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba58608-a631-4eed-938b-c14e753ebe4c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.260008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:16.321590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 341/667] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:16.321590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab2ce-4ecb-4baf-9865-25cb24c11836 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:16.371407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba58608-a631-4eed-938b-c14e753ebe4c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.406611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b22211-a3d6-4cce-8fe0-0c87484db20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.407247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b22211-a3d6-4cce-8fe0-0c87484db20d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.407526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b22211-a3d6-4cce-8fe0-0c87484db20d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.407832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b22211-a3d6-4cce-8fe0-0c87484db20d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.418615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b22211-a3d6-4cce-8fe0-0c87484db20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-b8b22211-a3d6-4cce-8fe0-0c87484db20d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:16.423974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:16.424960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:16.425819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:16.426469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab2ce-4ecb-4baf-9865-25cb24c11836 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.429980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 327/668] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:16.430923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b22211-a3d6-4cce-8fe0-0c87484db20d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.464236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd5285-92d9-4e9d-a96a-2bc9fb7d1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.464847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd5285-92d9-4e9d-a96a-2bc9fb7d1c41 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.465127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd5285-92d9-4e9d-a96a-2bc9fb7d1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.465399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd5285-92d9-4e9d-a96a-2bc9fb7d1c41 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.466028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd5285-92d9-4e9d-a96a-2bc9fb7d1c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:16.466328 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd5285-92d9-4e9d-a96a-2bc9fb7d1c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:16.467692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd5285-92d9-4e9d-a96a-2bc9fb7d1c41 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:16.479463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 342/669] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:16.480405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd5285-92d9-4e9d-a96a-2bc9fb7d1c41 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.490583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:16.539984 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b22211-a3d6-4cce-8fe0-0c87484db20d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.558152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:16.578518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b46e1-5bef-4131-b937-5458cbaef1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.579131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b46e1-5bef-4131-b937-5458cbaef1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.582023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b46e1-5bef-4131-b937-5458cbaef1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.582023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b46e1-5bef-4131-b937-5458cbaef1e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.582023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b46e1-5bef-4131-b937-5458cbaef1e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:16.582023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b46e1-5bef-4131-b937-5458cbaef1e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:16.582307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b46e1-5bef-4131-b937-5458cbaef1e6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:16.594288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd5285-92d9-4e9d-a96a-2bc9fb7d1c41 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.601124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 328/670] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:16.601124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b46e1-5bef-4131-b937-5458cbaef1e6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.629982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c6af-72b9-4c4d-a613-79410da78fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.630628 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c6af-72b9-4c4d-a613-79410da78fcf None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.630905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c6af-72b9-4c4d-a613-79410da78fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.631175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c6af-72b9-4c4d-a613-79410da78fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.643276 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c6af-72b9-4c4d-a613-79410da78fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:16.644865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c6af-72b9-4c4d-a613-79410da78fcf None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0022c6af-72b9-4c4d-a613-79410da78fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:16.661097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:16.662130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:16.663025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:16.663025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:16.663025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:16.663025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 343/671] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:16.663025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c6af-72b9-4c4d-a613-79410da78fcf None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.717805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b46e1-5bef-4131-b937-5458cbaef1e6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.726664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:16.754905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc1ab3-98d9-4208-8136-777132199fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.759414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc1ab3-98d9-4208-8136-777132199fff None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.759414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc1ab3-98d9-4208-8136-777132199fff None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.759414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc1ab3-98d9-4208-8136-777132199fff None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.759414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc1ab3-98d9-4208-8136-777132199fff None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:16.759414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc1ab3-98d9-4208-8136-777132199fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:16.759414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc1ab3-98d9-4208-8136-777132199fff None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:16.772023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 329/672] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:16.772023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc1ab3-98d9-4208-8136-777132199fff None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.777200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c6af-72b9-4c4d-a613-79410da78fcf None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.813496 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:16.816137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb89c27-55cf-410d-a4d6-a3a62bf13f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.816842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb89c27-55cf-410d-a4d6-a3a62bf13f2f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.817200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb89c27-55cf-410d-a4d6-a3a62bf13f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.817553 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb89c27-55cf-410d-a4d6-a3a62bf13f2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.825106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb89c27-55cf-410d-a4d6-a3a62bf13f2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:16.826556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb89c27-55cf-410d-a4d6-a3a62bf13f2f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-aeb89c27-55cf-410d-a4d6-a3a62bf13f2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:16.838338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:16.839388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 344/673] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:16.840302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb89c27-55cf-410d-a4d6-a3a62bf13f2f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.879852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc1ab3-98d9-4208-8136-777132199fff None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.917126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22950d4-0bc2-4f8d-9bb9-8b53ceeb9d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:16.917660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22950d4-0bc2-4f8d-9bb9-8b53ceeb9d08 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:16.917937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22950d4-0bc2-4f8d-9bb9-8b53ceeb9d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:16.918211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22950d4-0bc2-4f8d-9bb9-8b53ceeb9d08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:16.918934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22950d4-0bc2-4f8d-9bb9-8b53ceeb9d08 None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=decb5421872c4034bbbaa8c3cd9dcb5d) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:16.919243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22950d4-0bc2-4f8d-9bb9-8b53ceeb9d08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:16.920719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22950d4-0bc2-4f8d-9bb9-8b53ceeb9d08 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:16.935656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 330/674] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/role_assignments?user.id=decb5421872c4034bbbaa8c3cd9dcb5d&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:16.935656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22950d4-0bc2-4f8d-9bb9-8b53ceeb9d08 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:16.963048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb89c27-55cf-410d-a4d6-a3a62bf13f2f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:16.988078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:17.002714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab012e-224c-40e7-857e-44ebd8f91b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:17.003485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab012e-224c-40e7-857e-44ebd8f91b14 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.003875 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab012e-224c-40e7-857e-44ebd8f91b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.004225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab012e-224c-40e7-857e-44ebd8f91b14 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.004969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab012e-224c-40e7-857e-44ebd8f91b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:17.005372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab012e-224c-40e7-857e-44ebd8f91b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:17.007042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab012e-224c-40e7-857e-44ebd8f91b14 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:17.026586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 345/675] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:17.027803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab012e-224c-40e7-857e-44ebd8f91b14 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:17.072069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22950d4-0bc2-4f8d-9bb9-8b53ceeb9d08 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:17.074797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:17.122860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff874-8c1f-4e4a-ab15-2b121e85d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:17.124119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff874-8c1f-4e4a-ab15-2b121e85d539 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.125916 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff874-8c1f-4e4a-ab15-2b121e85d539 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.126365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff874-8c1f-4e4a-ab15-2b121e85d539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.143145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ff874-8c1f-4e4a-ab15-2b121e85d539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:17.144669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ff874-8c1f-4e4a-ab15-2b121e85d539 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:17.160461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab012e-224c-40e7-857e-44ebd8f91b14 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-a62ff874-8c1f-4e4a-ab15-2b121e85d539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:17.162806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:17.163885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:17.164841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:17.164841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:17.164841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:17.164841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 331/676] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:17.166467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff874-8c1f-4e4a-ab15-2b121e85d539 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:17.206116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49df50-6843-4c2d-84af-7258adf34bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:17.206701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49df50-6843-4c2d-84af-7258adf34bfc None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.206987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49df50-6843-4c2d-84af-7258adf34bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.207265 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49df50-6843-4c2d-84af-7258adf34bfc None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.208136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49df50-6843-4c2d-84af-7258adf34bfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:17.208587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49df50-6843-4c2d-84af-7258adf34bfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:17.209982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49df50-6843-4c2d-84af-7258adf34bfc None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:17.224013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 346/677] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:17.224867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49df50-6843-4c2d-84af-7258adf34bfc None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:17.279877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:17.286923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff874-8c1f-4e4a-ab15-2b121e85d539 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:17.330328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197ff9b-cac0-4ba9-9213-10f0f178edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:17.330966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197ff9b-cac0-4ba9-9213-10f0f178edf2 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.331249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197ff9b-cac0-4ba9-9213-10f0f178edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.331524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197ff9b-cac0-4ba9-9213-10f0f178edf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.341483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197ff9b-cac0-4ba9-9213-10f0f178edf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:17.343256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197ff9b-cac0-4ba9-9213-10f0f178edf2 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:17.346452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49df50-6843-4c2d-84af-7258adf34bfc None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4197ff9b-cac0-4ba9-9213-10f0f178edf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:17.357141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:17.358095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:17.359017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:17.359017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:17.359017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:17.359017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:17.359017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:17.359017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:17.359017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:17.359017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:17.359017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 332/678] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:17.359520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197ff9b-cac0-4ba9-9213-10f0f178edf2 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:17.383879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:17.396597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef5517-6e37-4c92-9fde-958bc99a39cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:17.397219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5517-6e37-4c92-9fde-958bc99a39cc None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.397930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5517-6e37-4c92-9fde-958bc99a39cc None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.399065 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5517-6e37-4c92-9fde-958bc99a39cc None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.400954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef5517-6e37-4c92-9fde-958bc99a39cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:17.401271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef5517-6e37-4c92-9fde-958bc99a39cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:17.402637 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef5517-6e37-4c92-9fde-958bc99a39cc None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:17.420652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 347/679] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:17.421932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef5517-6e37-4c92-9fde-958bc99a39cc None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:17.489628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197ff9b-cac0-4ba9-9213-10f0f178edf2 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:17.527190 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddfe86-c399-4ef6-96b3-bfb2f32aa3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:17.527986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddfe86-c399-4ef6-96b3-bfb2f32aa3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.528266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddfe86-c399-4ef6-96b3-bfb2f32aa3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.528546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddfe86-c399-4ef6-96b3-bfb2f32aa3a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.529273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ddfe86-c399-4ef6-96b3-bfb2f32aa3a3 None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=6ce95a25d894457d8cd45c30b38f014e) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:17.529585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ddfe86-c399-4ef6-96b3-bfb2f32aa3a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:17.531034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ddfe86-c399-4ef6-96b3-bfb2f32aa3a3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:17.544639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 333/680] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:17 2022] GET /identity/v3/role_assignments?user.id=6ce95a25d894457d8cd45c30b38f014e&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:17.546478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddfe86-c399-4ef6-96b3-bfb2f32aa3a3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:17.565954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:17.572687 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef5517-6e37-4c92-9fde-958bc99a39cc None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:17.616194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62d5a-cc19-4c9d-9c35-00e4e46193fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:17.617531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62d5a-cc19-4c9d-9c35-00e4e46193fd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.618556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62d5a-cc19-4c9d-9c35-00e4e46193fd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.619034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62d5a-cc19-4c9d-9c35-00e4e46193fd None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.620007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b62d5a-cc19-4c9d-9c35-00e4e46193fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:17.621110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b62d5a-cc19-4c9d-9c35-00e4e46193fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:17.623127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b62d5a-cc19-4c9d-9c35-00e4e46193fd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:17.639238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 348/681] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:17.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62d5a-cc19-4c9d-9c35-00e4e46193fd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:17.715457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:17.765971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddfe86-c399-4ef6-96b3-bfb2f32aa3a3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:17.829700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e426d-005d-4136-93c2-e6cca8c78ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:17.830306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e426d-005d-4136-93c2-e6cca8c78ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.830589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e426d-005d-4136-93c2-e6cca8c78ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.830866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e426d-005d-4136-93c2-e6cca8c78ff3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.835308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62d5a-cc19-4c9d-9c35-00e4e46193fd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:17.841474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e426d-005d-4136-93c2-e6cca8c78ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:17.842685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e426d-005d-4136-93c2-e6cca8c78ff3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-072e426d-005d-4136-93c2-e6cca8c78ff3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:17.858245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:17.859283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:17.860275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 334/682] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:17.866483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e426d-005d-4136-93c2-e6cca8c78ff3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:17.894001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df934d9b-e0b9-48cd-9e9a-e1256396ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:17.895007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df934d9b-e0b9-48cd-9e9a-e1256396ff9b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.895504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df934d9b-e0b9-48cd-9e9a-e1256396ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.895971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df934d9b-e0b9-48cd-9e9a-e1256396ff9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.896895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df934d9b-e0b9-48cd-9e9a-e1256396ff9b None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=88d492b570be4de4b6a6d85f6374ed31) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:17.897396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df934d9b-e0b9-48cd-9e9a-e1256396ff9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:17.900351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df934d9b-e0b9-48cd-9e9a-e1256396ff9b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:17.911804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 349/683] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:17 2022] GET /identity/v3/role_assignments?user.id=88d492b570be4de4b6a6d85f6374ed31&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:17.959484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067597b-0e59-465b-81d5-ea331e580820 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.959806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067597b-0e59-465b-81d5-ea331e580820 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.960091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067597b-0e59-465b-81d5-ea331e580820 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.961633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 350/684] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:59:17.968152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ee6a4-62f4-4cf0-a017-870171246c89 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:17.968453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ee6a4-62f4-4cf0-a017-870171246c89 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:17.968701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ee6a4-62f4-4cf0-a017-870171246c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:17.990039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e426d-005d-4136-93c2-e6cca8c78ff3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:17.992064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-1d0ee6a4-62f4-4cf0-a017-870171246c89 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:17.993852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1d0ee6a4-62f4-4cf0-a017-870171246c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:18.017996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:18.046270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af046a6-6842-4ac7-a692-fdc003e9481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:18.047233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af046a6-6842-4ac7-a692-fdc003e9481c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:18.047763 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af046a6-6842-4ac7-a692-fdc003e9481c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:18.049686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af046a6-6842-4ac7-a692-fdc003e9481c None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:18.050674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af046a6-6842-4ac7-a692-fdc003e9481c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:18.051158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af046a6-6842-4ac7-a692-fdc003e9481c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:18.053443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af046a6-6842-4ac7-a692-fdc003e9481c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:18.079056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:18.084212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 335/685] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 11:59:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:18.090610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af046a6-6842-4ac7-a692-fdc003e9481c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:18.092123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 351/686] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:59:18.236598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af046a6-6842-4ac7-a692-fdc003e9481c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:18.276441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665ba91-922b-4ac0-889e-8b8a87b720b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:18.277285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665ba91-922b-4ac0-889e-8b8a87b720b2 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:18.277718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665ba91-922b-4ac0-889e-8b8a87b720b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:18.278142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665ba91-922b-4ac0-889e-8b8a87b720b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:18.349176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:18.353627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665ba91-922b-4ac0-889e-8b8a87b720b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:18.355269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665ba91-922b-4ac0-889e-8b8a87b720b2 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:18.404312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ee6a4-62f4-4cf0-a017-870171246c89 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:18.484187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 336/687] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:18.489230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665ba91-922b-4ac0-889e-8b8a87b720b2 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:18.561466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ee6a4-62f4-4cf0-a017-870171246c89 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:18.599226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e48d7-f62f-4037-981e-0c1b39d4895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:18.600877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e48d7-f62f-4037-981e-0c1b39d4895b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:18.601363 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e48d7-f62f-4037-981e-0c1b39d4895b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:18.601863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e48d7-f62f-4037-981e-0c1b39d4895b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:18.612980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e48d7-f62f-4037-981e-0c1b39d4895b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-f22e48d7-f62f-4037-981e-0c1b39d4895b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:18.618750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:18.619723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:18.620570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:18.623216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 352/688] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:18.630668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e48d7-f62f-4037-981e-0c1b39d4895b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:18.664022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:18.720453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665ba91-922b-4ac0-889e-8b8a87b720b2 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:18.722193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:18.782856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5b29e-814a-473a-b512-fb6ca0174d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:18.783957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5b29e-814a-473a-b512-fb6ca0174d09 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:18.784474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5b29e-814a-473a-b512-fb6ca0174d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:18.784960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5b29e-814a-473a-b512-fb6ca0174d09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:18.799004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5b29e-814a-473a-b512-fb6ca0174d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:18.801784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5b29e-814a-473a-b512-fb6ca0174d09 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:18.805881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e48d7-f62f-4037-981e-0c1b39d4895b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-edf5b29e-814a-473a-b512-fb6ca0174d09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:18.837045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:18.838083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:18.839031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:18.839031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:18.839031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:18.844910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 337/689] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:18.848524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5b29e-814a-473a-b512-fb6ca0174d09 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:18.877419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bae76e-939e-4a07-9c71-1fdf0126d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:18.878411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bae76e-939e-4a07-9c71-1fdf0126d099 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:18.878909 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bae76e-939e-4a07-9c71-1fdf0126d099 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:18.879706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bae76e-939e-4a07-9c71-1fdf0126d099 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:18.880644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bae76e-939e-4a07-9c71-1fdf0126d099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:18.881175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bae76e-939e-4a07-9c71-1fdf0126d099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:18.882767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bae76e-939e-4a07-9c71-1fdf0126d099 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:18.893367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 353/690] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:18.899243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bae76e-939e-4a07-9c71-1fdf0126d099 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:18.995156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5b29e-814a-473a-b512-fb6ca0174d09 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:19.036146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807592f5-a046-4bdc-aef3-58b80bae144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:19.037499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807592f5-a046-4bdc-aef3-58b80bae144c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:19.037993 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807592f5-a046-4bdc-aef3-58b80bae144c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:19.038947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807592f5-a046-4bdc-aef3-58b80bae144c None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:19.040450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807592f5-a046-4bdc-aef3-58b80bae144c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:19.041131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807592f5-a046-4bdc-aef3-58b80bae144c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:19.042789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807592f5-a046-4bdc-aef3-58b80bae144c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:19.058112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 338/691] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:19.067676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807592f5-a046-4bdc-aef3-58b80bae144c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:19.085340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:19.090547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:19.113537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bae76e-939e-4a07-9c71-1fdf0126d099 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:19.150504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745789-5d96-4513-a315-55b7b916b6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:19.151284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745789-5d96-4513-a315-55b7b916b6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:19.151988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745789-5d96-4513-a315-55b7b916b6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:19.152491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745789-5d96-4513-a315-55b7b916b6b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:19.163556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a745789-5d96-4513-a315-55b7b916b6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:19.165760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a745789-5d96-4513-a315-55b7b916b6b4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0a745789-5d96-4513-a315-55b7b916b6b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:19.180707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:19.182027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:19.183067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:19.183067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:19.183067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:19.188084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 354/692] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:19.189709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745789-5d96-4513-a315-55b7b916b6b4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:19.286398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807592f5-a046-4bdc-aef3-58b80bae144c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:19.294172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745789-5d96-4513-a315-55b7b916b6b4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:19.327515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8297002-766f-407a-a7a0-8c217ea863c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:19.329262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8297002-766f-407a-a7a0-8c217ea863c4 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:19.329756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8297002-766f-407a-a7a0-8c217ea863c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:19.330480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8297002-766f-407a-a7a0-8c217ea863c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:19.338703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8297002-766f-407a-a7a0-8c217ea863c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:19.341116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8297002-766f-407a-a7a0-8c217ea863c4 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-d8297002-766f-407a-a7a0-8c217ea863c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:19.354252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:19.355178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:19.356118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:19.356118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:19.356118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:19.356118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:19.356118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:19.356118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:19.356118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:19.356118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:19.358594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 339/693] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:19.360078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:19.367744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8297002-766f-407a-a7a0-8c217ea863c4 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:19.382902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b2baf-caaa-4c15-9cad-6d10398519ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:19.384374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b2baf-caaa-4c15-9cad-6d10398519ac None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:19.384796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b2baf-caaa-4c15-9cad-6d10398519ac None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:19.385206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b2baf-caaa-4c15-9cad-6d10398519ac None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:19.385991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b2baf-caaa-4c15-9cad-6d10398519ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:19.386435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b2baf-caaa-4c15-9cad-6d10398519ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:19.390104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b2baf-caaa-4c15-9cad-6d10398519ac None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:19.410371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 355/694] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:19.416728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b2baf-caaa-4c15-9cad-6d10398519ac None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:19.504173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:19.579983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b2baf-caaa-4c15-9cad-6d10398519ac None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:19.581770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8297002-766f-407a-a7a0-8c217ea863c4 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:19.614375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caaf23-e634-4f67-87c3-f174ee9a0b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:19.615021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caaf23-e634-4f67-87c3-f174ee9a0b47 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:19.615202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caaf23-e634-4f67-87c3-f174ee9a0b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:19.615461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caaf23-e634-4f67-87c3-f174ee9a0b47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:19.623505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00caaf23-e634-4f67-87c3-f174ee9a0b47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:19.625032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00caaf23-e634-4f67-87c3-f174ee9a0b47 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-00caaf23-e634-4f67-87c3-f174ee9a0b47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:19.638721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:19.639715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:19.641028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 356/695] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 11:59:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:19.641854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f87b5f-2cec-44ec-bf1f-e0c7e259510e None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:19.643089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f87b5f-2cec-44ec-bf1f-e0c7e259510e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:19.643089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f87b5f-2cec-44ec-bf1f-e0c7e259510e None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:19.644197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 357/696] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:19.648128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f87b5f-2cec-44ec-bf1f-e0c7e259510e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:19.652722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfc5e0-2657-41b0-a74b-3f38fc29e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:19.653603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfc5e0-2657-41b0-a74b-3f38fc29e60d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:19.654086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfc5e0-2657-41b0-a74b-3f38fc29e60d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:19.654559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfc5e0-2657-41b0-a74b-3f38fc29e60d None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:19.655448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfc5e0-2657-41b0-a74b-3f38fc29e60d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:19.656008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfc5e0-2657-41b0-a74b-3f38fc29e60d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:19.657786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfc5e0-2657-41b0-a74b-3f38fc29e60d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:19.673161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 340/697] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:19.674692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd46d4e-fd58-4267-a509-4fc60e6940e3 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:19.675202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd46d4e-fd58-4267-a509-4fc60e6940e3 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:19.675742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd46d4e-fd58-4267-a509-4fc60e6940e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:19.695435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6cd46d4e-fd58-4267-a509-4fc60e6940e3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:19.697032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6cd46d4e-fd58-4267-a509-4fc60e6940e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:19.706639 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:19.770734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f87b5f-2cec-44ec-bf1f-e0c7e259510e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:19.772042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 341/698] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:19.773403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd46d4e-fd58-4267-a509-4fc60e6940e3 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:19.826177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8d7f0-9e79-4e17-b329-a85a8001c062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:19.827227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8d7f0-9e79-4e17-b329-a85a8001c062 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:19.827791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8d7f0-9e79-4e17-b329-a85a8001c062 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:19.828337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8d7f0-9e79-4e17-b329-a85a8001c062 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:19.829301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8d7f0-9e79-4e17-b329-a85a8001c062 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:19.831565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8d7f0-9e79-4e17-b329-a85a8001c062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:19.834173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8d7f0-9e79-4e17-b329-a85a8001c062 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:19.868140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:19.871600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 358/699] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 11:59:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:19.875019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8d7f0-9e79-4e17-b329-a85a8001c062 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:19.943385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd46d4e-fd58-4267-a509-4fc60e6940e3 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:20.009772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d773b5-56ea-4829-98d7-0058729c83ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:20.010701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d773b5-56ea-4829-98d7-0058729c83ad None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.011161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d773b5-56ea-4829-98d7-0058729c83ad None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.011612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d773b5-56ea-4829-98d7-0058729c83ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.012575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d773b5-56ea-4829-98d7-0058729c83ad None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=063f7bf74f444c14b9bf6c0ca936dd12) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:20.013064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d773b5-56ea-4829-98d7-0058729c83ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:20.014669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d773b5-56ea-4829-98d7-0058729c83ad None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:20.030098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 342/700] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:19 2022] GET /identity/v3/role_assignments?user.id=063f7bf74f444c14b9bf6c0ca936dd12&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:20.043836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8d7f0-9e79-4e17-b329-a85a8001c062 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:20.046444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:20.061729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d773b5-56ea-4829-98d7-0058729c83ad None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:20.127730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca228e7b-00d7-43de-9f8b-0f8515e9175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:20.127730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca228e7b-00d7-43de-9f8b-0f8515e9175d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.127730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca228e7b-00d7-43de-9f8b-0f8515e9175d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.127730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca228e7b-00d7-43de-9f8b-0f8515e9175d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.235283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d773b5-56ea-4829-98d7-0058729c83ad None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:20.263095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca228e7b-00d7-43de-9f8b-0f8515e9175d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:20.263796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:20.264667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca228e7b-00d7-43de-9f8b-0f8515e9175d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:20.290649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cf68b-3eb7-4b84-a606-05965fcec19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:20.291322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cf68b-3eb7-4b84-a606-05965fcec19d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.291606 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cf68b-3eb7-4b84-a606-05965fcec19d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.291909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cf68b-3eb7-4b84-a606-05965fcec19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.310417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cf68b-3eb7-4b84-a606-05965fcec19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:20.314793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cf68b-3eb7-4b84-a606-05965fcec19d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-b84cf68b-3eb7-4b84-a606-05965fcec19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:20.332798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:20.333824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:20.335466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:20.335466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:20.335466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:20.335466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 343/701] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:20.340565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cf68b-3eb7-4b84-a606-05965fcec19d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:20.374539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 359/702] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:20.380442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca228e7b-00d7-43de-9f8b-0f8515e9175d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:20.383366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:20.465857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cf68b-3eb7-4b84-a606-05965fcec19d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:20.509367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656b63d-dd1b-4ca1-bc0a-eff531a60c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:20.509968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b63d-dd1b-4ca1-bc0a-eff531a60c0e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.510253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b63d-dd1b-4ca1-bc0a-eff531a60c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.510529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b63d-dd1b-4ca1-bc0a-eff531a60c0e None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.511170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656b63d-dd1b-4ca1-bc0a-eff531a60c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:20.511532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656b63d-dd1b-4ca1-bc0a-eff531a60c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:20.512952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656b63d-dd1b-4ca1-bc0a-eff531a60c0e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:20.515237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca228e7b-00d7-43de-9f8b-0f8515e9175d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:20.527393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 344/703] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:20.528532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726295d-a57c-4334-ae20-cbfeedd538bc None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.528882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726295d-a57c-4334-ae20-cbfeedd538bc None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.529231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726295d-a57c-4334-ae20-cbfeedd538bc None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.534863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 345/704] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:20.535835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726295d-a57c-4334-ae20-cbfeedd538bc None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:20.565381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ef35d-90b3-47b9-ac49-a98672af7412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:20.566036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef35d-90b3-47b9-ac49-a98672af7412 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.566320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef35d-90b3-47b9-ac49-a98672af7412 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.566604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef35d-90b3-47b9-ac49-a98672af7412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.583210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ef35d-90b3-47b9-ac49-a98672af7412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:20.585036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ef35d-90b3-47b9-ac49-a98672af7412 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:20.589453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-d01ef35d-90b3-47b9-ac49-a98672af7412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:20.602937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:20.604008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:20.605330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:20.605330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:20.605330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:20.605330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 360/705] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:20.608715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f672-1544-45a1-8c65-99190dc40f59 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.609318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f672-1544-45a1-8c65-99190dc40f59 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.610641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f672-1544-45a1-8c65-99190dc40f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.635684 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8485f672-1544-45a1-8c65-99190dc40f59 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:20.636929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8485f672-1544-45a1-8c65-99190dc40f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:20.687888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726295d-a57c-4334-ae20-cbfeedd538bc None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:20.698316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:20.727659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 361/706] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:20.727659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f672-1544-45a1-8c65-99190dc40f59 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:20.738358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8c221-c8ed-42a1-a59e-4659be66eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:20.738981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c221-c8ed-42a1-a59e-4659be66eb23 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.739262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c221-c8ed-42a1-a59e-4659be66eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.739681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c221-c8ed-42a1-a59e-4659be66eb23 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.740334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c221-c8ed-42a1-a59e-4659be66eb23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:20.741774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c221-c8ed-42a1-a59e-4659be66eb23 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:20.833927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f672-1544-45a1-8c65-99190dc40f59 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:20.863680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 346/707] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 11:59:20 2022] POST /identity/v3/users => generated 254 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:20.863680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7daf3-c0a4-4c95-b007-5038fd0ee235 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.863680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7daf3-c0a4-4c95-b007-5038fd0ee235 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.863680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7daf3-c0a4-4c95-b007-5038fd0ee235 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.869096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 347/708] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:20.870580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15013bc1-362a-4722-8384-e6af173cbbc2 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.870861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15013bc1-362a-4722-8384-e6af173cbbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.871133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15013bc1-362a-4722-8384-e6af173cbbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.901231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a79cc3-cc8a-45e2-8b31-22906394c9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:20.901774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79cc3-cc8a-45e2-8b31-22906394c9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:20.902051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79cc3-cc8a-45e2-8b31-22906394c9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:20.902319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79cc3-cc8a-45e2-8b31-22906394c9e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:20.904273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a79cc3-cc8a-45e2-8b31-22906394c9e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:20.904622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a79cc3-cc8a-45e2-8b31-22906394c9e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:20.908418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a79cc3-cc8a-45e2-8b31-22906394c9e0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:20.911109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-15013bc1-362a-4722-8384-e6af173cbbc2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:20.912507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-15013bc1-362a-4722-8384-e6af173cbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:20.939137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 362/709] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:20.945937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a79cc3-cc8a-45e2-8b31-22906394c9e0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:21.002196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 348/710] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:59:21.020703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15013bc1-362a-4722-8384-e6af173cbbc2 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:21.054574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:21.071588 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:21.137097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a79cc3-cc8a-45e2-8b31-22906394c9e0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:21.174625 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15013bc1-362a-4722-8384-e6af173cbbc2 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:21.185765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38caef-ecc6-4a9c-8341-cebf40f3dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:21.186427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38caef-ecc6-4a9c-8341-cebf40f3dce8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:21.186709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38caef-ecc6-4a9c-8341-cebf40f3dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:21.186984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38caef-ecc6-4a9c-8341-cebf40f3dce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:21.196038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38caef-ecc6-4a9c-8341-cebf40f3dce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:21.197486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38caef-ecc6-4a9c-8341-cebf40f3dce8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-3f38caef-ecc6-4a9c-8341-cebf40f3dce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:21.212624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:21.213736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:21.214844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:21.214844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:21.214844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:21.214844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:21.214844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:21.214844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:21.214844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:21.214844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:21.214844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 363/711] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:21.222964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38caef-ecc6-4a9c-8341-cebf40f3dce8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:21.225497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dd592-9489-4433-b739-5a7d6ba806dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:21.226620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dd592-9489-4433-b739-5a7d6ba806dc None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:21.228704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dd592-9489-4433-b739-5a7d6ba806dc None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:21.229194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dd592-9489-4433-b739-5a7d6ba806dc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:21.230024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dd592-9489-4433-b739-5a7d6ba806dc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:21.231592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dd592-9489-4433-b739-5a7d6ba806dc None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-0e7dd592-9489-4433-b739-5a7d6ba806dc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:21.246927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:21.248476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:59:21.249348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:21.252410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 349/712] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Sep 9 11:59:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:21.258830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dd592-9489-4433-b739-5a7d6ba806dc None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:21.356878 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38caef-ecc6-4a9c-8341-cebf40f3dce8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:21.363851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:21.366654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:21.385101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dd592-9489-4433-b739-5a7d6ba806dc None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:21.394182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a73bd0-e1dc-499b-8bd9-81da6157f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:21.394942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a73bd0-e1dc-499b-8bd9-81da6157f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:21.395142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a73bd0-e1dc-499b-8bd9-81da6157f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:21.395538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a73bd0-e1dc-499b-8bd9-81da6157f4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:21.396324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a73bd0-e1dc-499b-8bd9-81da6157f4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:21.396698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a73bd0-e1dc-499b-8bd9-81da6157f4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:21.398295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a73bd0-e1dc-499b-8bd9-81da6157f4b5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:21.417738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 364/713] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:21.418740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a73bd0-e1dc-499b-8bd9-81da6157f4b5 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:21.438708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6ba2-20ea-4905-a9cd-a616fd40e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:21.439792 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6ba2-20ea-4905-a9cd-a616fd40e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:21.440527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6ba2-20ea-4905-a9cd-a616fd40e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:21.440961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6ba2-20ea-4905-a9cd-a616fd40e5c1 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:21.441746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d6ba2-20ea-4905-a9cd-a616fd40e5c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:21.442220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d6ba2-20ea-4905-a9cd-a616fd40e5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:21.444233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d6ba2-20ea-4905-a9cd-a616fd40e5c1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:21.455907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 350/714] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 11:59:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:21.457131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6ba2-20ea-4905-a9cd-a616fd40e5c1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:21.530363 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a73bd0-e1dc-499b-8bd9-81da6157f4b5 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:21.566542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6ba2-20ea-4905-a9cd-a616fd40e5c1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:21.566771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83d58d-efd3-44f3-a2aa-da90d337ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:21.567450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83d58d-efd3-44f3-a2aa-da90d337ed3d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:21.567826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83d58d-efd3-44f3-a2aa-da90d337ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:21.568170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83d58d-efd3-44f3-a2aa-da90d337ed3d None admin] PATH_INFO: `/v3/services/network` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:21.568820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83d58d-efd3-44f3-a2aa-da90d337ed3d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:21.570782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83d58d-efd3-44f3-a2aa-da90d337ed3d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-2b83d58d-efd3-44f3-a2aa-da90d337ed3d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:21.588733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:21.589880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:59:21.591159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:21.594933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 365/715] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:21 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:21.595989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83d58d-efd3-44f3-a2aa-da90d337ed3d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:21.609242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be851f66-05e8-4344-9344-bf211e672e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:21.610186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be851f66-05e8-4344-9344-bf211e672e79 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:21.610707 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be851f66-05e8-4344-9344-bf211e672e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:21.611160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be851f66-05e8-4344-9344-bf211e672e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:21.612100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be851f66-05e8-4344-9344-bf211e672e79 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=4971acb91bbf498887606c5ba5d00176) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:21.612597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be851f66-05e8-4344-9344-bf211e672e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:21.614416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be851f66-05e8-4344-9344-bf211e672e79 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:21.621045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 351/716] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:21 2022] GET /identity/v3/role_assignments?user.id=4971acb91bbf498887606c5ba5d00176&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=06592016669243d99b430c46dd1c1d46 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:21.622174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be851f66-05e8-4344-9344-bf211e672e79 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:21.631157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:21.643009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:21.714377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83d58d-efd3-44f3-a2aa-da90d337ed3d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:21.744277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be851f66-05e8-4344-9344-bf211e672e79 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:21.752602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8d7f1-3a34-4b36-a5de-112a4034e650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:21.753392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8d7f1-3a34-4b36-a5de-112a4034e650 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:21.753786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8d7f1-3a34-4b36-a5de-112a4034e650 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:21.754131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8d7f1-3a34-4b36-a5de-112a4034e650 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:21.754836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8d7f1-3a34-4b36-a5de-112a4034e650 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:21.755210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8d7f1-3a34-4b36-a5de-112a4034e650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:21.756865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8d7f1-3a34-4b36-a5de-112a4034e650 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:21.764182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 366/717] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 11:59:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:21.789216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df62eb-ebad-44f6-bdce-f0badb13a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:21.790269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df62eb-ebad-44f6-bdce-f0badb13a563 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:21.790740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df62eb-ebad-44f6-bdce-f0badb13a563 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:21.791198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df62eb-ebad-44f6-bdce-f0badb13a563 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:21.792096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df62eb-ebad-44f6-bdce-f0badb13a563 None admin] RBAC: Adding query filter params (name=network) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:21.792598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df62eb-ebad-44f6-bdce-f0badb13a563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:21.794256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df62eb-ebad-44f6-bdce-f0badb13a563 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:21.800196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 352/718] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:21.807684 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8d7f1-3a34-4b36-a5de-112a4034e650 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:21.947517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:21.956195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8d7f1-3a34-4b36-a5de-112a4034e650 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:22.013424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bcfe0-41ae-46c0-a074-ace910c666dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:22.013977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bcfe0-41ae-46c0-a074-ace910c666dd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:22.014261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bcfe0-41ae-46c0-a074-ace910c666dd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:22.014538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bcfe0-41ae-46c0-a074-ace910c666dd None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:22.015195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bcfe0-41ae-46c0-a074-ace910c666dd None admin] RBAC: Adding query filter params (type=network) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:22.015503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bcfe0-41ae-46c0-a074-ace910c666dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:22.016914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bcfe0-41ae-46c0-a074-ace910c666dd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:22.022351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 367/719] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:22.635434 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fabbd-fb2c-4d89-a910-1bcd4c78e059 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:22.635978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fabbd-fb2c-4d89-a910-1bcd4c78e059 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:22.635978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fabbd-fb2c-4d89-a910-1bcd4c78e059 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:22.637546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 353/720] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:22.643225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4bf8a-6970-43d7-9470-8eb39508def8 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:22.643529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4bf8a-6970-43d7-9470-8eb39508def8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:22.643838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4bf8a-6970-43d7-9470-8eb39508def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:22.669736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2ff4bf8a-6970-43d7-9470-8eb39508def8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:22.671049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2ff4bf8a-6970-43d7-9470-8eb39508def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:22.760315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 368/721] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:23.110370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fabbd-fb2c-4d89-a910-1bcd4c78e059 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:23.226092 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:23.261116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fabbd-fb2c-4d89-a910-1bcd4c78e059 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:23.309653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578dded-aab9-4741-b20c-8e918c2bc636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:23.310640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578dded-aab9-4741-b20c-8e918c2bc636 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:23.311200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578dded-aab9-4741-b20c-8e918c2bc636 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:23.311726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578dded-aab9-4741-b20c-8e918c2bc636 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:23.332468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578dded-aab9-4741-b20c-8e918c2bc636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-b578dded-aab9-4741-b20c-8e918c2bc636 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:23.338147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:23.339065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:23.339930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:23.342321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 354/722] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:23.347712 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4bf8a-6970-43d7-9470-8eb39508def8 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:23.474197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:23.492009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4bf8a-6970-43d7-9470-8eb39508def8 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:23.542694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25769afb-69e9-490f-82ca-f003cb1e2a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:23.543304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25769afb-69e9-490f-82ca-f003cb1e2a1d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:23.543579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25769afb-69e9-490f-82ca-f003cb1e2a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:23.543873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25769afb-69e9-490f-82ca-f003cb1e2a1d None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:23.544540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25769afb-69e9-490f-82ca-f003cb1e2a1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:23.544839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25769afb-69e9-490f-82ca-f003cb1e2a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:23.546179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25769afb-69e9-490f-82ca-f003cb1e2a1d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:23.554864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 369/723] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:23.560953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578dded-aab9-4741-b20c-8e918c2bc636 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:23.747893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578dded-aab9-4741-b20c-8e918c2bc636 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:23.822338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466fc1b-86f5-44a2-8324-4d095e040d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:23.822979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466fc1b-86f5-44a2-8324-4d095e040d3d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:23.823264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466fc1b-86f5-44a2-8324-4d095e040d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:23.823544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466fc1b-86f5-44a2-8324-4d095e040d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:23.831123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:23.835646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466fc1b-86f5-44a2-8324-4d095e040d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:23.837245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466fc1b-86f5-44a2-8324-4d095e040d3d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-d466fc1b-86f5-44a2-8324-4d095e040d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:23.852860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:23.853930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:23.854814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:23.854814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:23.854814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:23.854814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 355/724] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:23.859583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25769afb-69e9-490f-82ca-f003cb1e2a1d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:23.905183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2acac3-ae6d-418f-996a-907d818d6431 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:23.905469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2acac3-ae6d-418f-996a-907d818d6431 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:23.905858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2acac3-ae6d-418f-996a-907d818d6431 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:23.908634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 356/725] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:59:23.912819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e538a57-1731-4ab4-8af2-7e8d3f4563a0 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:23.913109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e538a57-1731-4ab4-8af2-7e8d3f4563a0 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:23.913487 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e538a57-1731-4ab4-8af2-7e8d3f4563a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:23.952958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6e538a57-1731-4ab4-8af2-7e8d3f4563a0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:23.954168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6e538a57-1731-4ab4-8af2-7e8d3f4563a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:24.009863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25769afb-69e9-490f-82ca-f003cb1e2a1d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:24.057355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbece4-924f-4911-88c8-a2bfbe977d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:24.057980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbece4-924f-4911-88c8-a2bfbe977d6e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.058263 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbece4-924f-4911-88c8-a2bfbe977d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.058542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbece4-924f-4911-88c8-a2bfbe977d6e None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.059200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbece4-924f-4911-88c8-a2bfbe977d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:24.059506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbece4-924f-4911-88c8-a2bfbe977d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:24.060590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 357/726] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:59:24.060910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbece4-924f-4911-88c8-a2bfbe977d6e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:24.075348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 370/727] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:24.080490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e538a57-1731-4ab4-8af2-7e8d3f4563a0 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:24.245052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e538a57-1731-4ab4-8af2-7e8d3f4563a0 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:24.271522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:24.294103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0197d79-03e2-4a22-a8aa-cd89188b4e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:24.294756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0197d79-03e2-4a22-a8aa-cd89188b4e3d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.295040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0197d79-03e2-4a22-a8aa-cd89188b4e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.295317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0197d79-03e2-4a22-a8aa-cd89188b4e3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.304123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0197d79-03e2-4a22-a8aa-cd89188b4e3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:24.305618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0197d79-03e2-4a22-a8aa-cd89188b4e3d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-e0197d79-03e2-4a22-a8aa-cd89188b4e3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:24.322576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:24.323600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:24.324591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 358/728] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:24.329296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbece4-924f-4911-88c8-a2bfbe977d6e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:24.345538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7c15a-858d-44f5-b75a-ffb48d865d91 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.345837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7c15a-858d-44f5-b75a-ffb48d865d91 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.346091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7c15a-858d-44f5-b75a-ffb48d865d91 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.347702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 359/729] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:24.353651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5695-b9c7-430f-9541-991396152c3c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.353949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5695-b9c7-430f-9541-991396152c3c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.354192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5695-b9c7-430f-9541-991396152c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.368080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:24.398930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6a3e5695-b9c7-430f-9541-991396152c3c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:24.403299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6a3e5695-b9c7-430f-9541-991396152c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:24.512721 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 360/730] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:24.518785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5695-b9c7-430f-9541-991396152c3c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:24.539073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbece4-924f-4911-88c8-a2bfbe977d6e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:24.599674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc80f5-2179-4def-95b0-ac197df50dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:24.600317 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc80f5-2179-4def-95b0-ac197df50dfe None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.600595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc80f5-2179-4def-95b0-ac197df50dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.600866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc80f5-2179-4def-95b0-ac197df50dfe None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.601597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc80f5-2179-4def-95b0-ac197df50dfe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:24.601899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc80f5-2179-4def-95b0-ac197df50dfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:24.603957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc80f5-2179-4def-95b0-ac197df50dfe None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:24.622591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 371/731] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 11:59:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:24.633199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc80f5-2179-4def-95b0-ac197df50dfe None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:24.670630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5695-b9c7-430f-9541-991396152c3c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:24.684228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:24.716965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:24.720745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af262bc-744b-4ff3-8107-b6795d5455dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:24.722491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af262bc-744b-4ff3-8107-b6795d5455dd None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.722982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af262bc-744b-4ff3-8107-b6795d5455dd None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.723458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af262bc-744b-4ff3-8107-b6795d5455dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.740092 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af262bc-744b-4ff3-8107-b6795d5455dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4af262bc-744b-4ff3-8107-b6795d5455dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:24.746974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:24.747966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:24.749266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 361/732] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:24.750862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6273-3de3-4891-8a7f-b083ce60c689 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.750966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6273-3de3-4891-8a7f-b083ce60c689 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.751205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6273-3de3-4891-8a7f-b083ce60c689 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.762028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 362/733] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:24.762028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c6273-3de3-4891-8a7f-b083ce60c689 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:24.764926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc80f5-2179-4def-95b0-ac197df50dfe None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:24.809152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a410f-0d6f-47c7-8086-41a12a02dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:24.810057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a410f-0d6f-47c7-8086-41a12a02dcbb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.810677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a410f-0d6f-47c7-8086-41a12a02dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.811037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a410f-0d6f-47c7-8086-41a12a02dcbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.880420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c6273-3de3-4891-8a7f-b083ce60c689 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:24.888691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a410f-0d6f-47c7-8086-41a12a02dcbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:24.890167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a410f-0d6f-47c7-8086-41a12a02dcbb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:24.919089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a11928-1ef3-4718-bc05-582f878adcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:24.920053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a11928-1ef3-4718-bc05-582f878adcba None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.920514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a11928-1ef3-4718-bc05-582f878adcba None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.920965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a11928-1ef3-4718-bc05-582f878adcba None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.921817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a11928-1ef3-4718-bc05-582f878adcba None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:24.922188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a11928-1ef3-4718-bc05-582f878adcba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:24.923553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a11928-1ef3-4718-bc05-582f878adcba None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:24.932676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 363/734] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:24.933894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc158-53fb-45a8-9163-2411ff42cca2 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:24.934189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc158-53fb-45a8-9163-2411ff42cca2 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:24.934464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc158-53fb-45a8-9163-2411ff42cca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:24.953274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-01ebc158-53fb-45a8-9163-2411ff42cca2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:24.954465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-01ebc158-53fb-45a8-9163-2411ff42cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:24.964934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:24.982256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:24.998914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 372/735] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:24.999783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a410f-0d6f-47c7-8086-41a12a02dcbb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.021638 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 364/736] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:25.022485 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebc158-53fb-45a8-9163-2411ff42cca2 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.108751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a410f-0d6f-47c7-8086-41a12a02dcbb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:25.135323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebc158-53fb-45a8-9163-2411ff42cca2 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:25.151715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd2091-5c32-4bf4-ae3c-93334e7ad7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:25.152349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd2091-5c32-4bf4-ae3c-93334e7ad7ca None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.152627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd2091-5c32-4bf4-ae3c-93334e7ad7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.152897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd2091-5c32-4bf4-ae3c-93334e7ad7ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.163182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd2091-5c32-4bf4-ae3c-93334e7ad7ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-3abd2091-5c32-4bf4-ae3c-93334e7ad7ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:25.168269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:25.169307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:25.170766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 373/737] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:25.171458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc957120-1278-4871-a27e-0e128d0a738e None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.171458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc957120-1278-4871-a27e-0e128d0a738e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.171597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc957120-1278-4871-a27e-0e128d0a738e None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.172877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 374/738] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:25.173463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc957120-1278-4871-a27e-0e128d0a738e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.180408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c50368-e5e9-48ef-9e6c-8e72d6e987d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:25.181597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c50368-e5e9-48ef-9e6c-8e72d6e987d1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.181883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c50368-e5e9-48ef-9e6c-8e72d6e987d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.182160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c50368-e5e9-48ef-9e6c-8e72d6e987d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.199062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c50368-e5e9-48ef-9e6c-8e72d6e987d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:25.201229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c50368-e5e9-48ef-9e6c-8e72d6e987d1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:25.204152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-19c50368-e5e9-48ef-9e6c-8e72d6e987d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:25.220828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:25.221823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:25.222772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:25.222772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:25.222772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:25.223974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 365/739] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:25.225648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c50368-e5e9-48ef-9e6c-8e72d6e987d1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.242023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:25.282702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc957120-1278-4871-a27e-0e128d0a738e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:25.317238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2db4f4-b9a9-4095-b999-e6ca38791999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:25.317868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2db4f4-b9a9-4095-b999-e6ca38791999 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.318155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2db4f4-b9a9-4095-b999-e6ca38791999 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.318430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2db4f4-b9a9-4095-b999-e6ca38791999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.328752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2db4f4-b9a9-4095-b999-e6ca38791999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:25.330192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2db4f4-b9a9-4095-b999-e6ca38791999 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:25.330569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c50368-e5e9-48ef-9e6c-8e72d6e987d1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-7a2db4f4-b9a9-4095-b999-e6ca38791999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:25.344738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:25.345742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:25.346636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:25.346636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:25.346636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:25.346636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 375/740] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:25.347063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9d63a-fde5-4e54-a955-99402fb103e3 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.347225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9d63a-fde5-4e54-a955-99402fb103e3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.347491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9d63a-fde5-4e54-a955-99402fb103e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.364722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-acc9d63a-fde5-4e54-a955-99402fb103e3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:25.365910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-acc9d63a-fde5-4e54-a955-99402fb103e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:25.370366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218744a3-3b98-40dd-ad83-fb279a857bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:25.370973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218744a3-3b98-40dd-ad83-fb279a857bad None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.371254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218744a3-3b98-40dd-ad83-fb279a857bad None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.371529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218744a3-3b98-40dd-ad83-fb279a857bad None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.372224 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218744a3-3b98-40dd-ad83-fb279a857bad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:25.372534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218744a3-3b98-40dd-ad83-fb279a857bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:25.373906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218744a3-3b98-40dd-ad83-fb279a857bad None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:25.382187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 366/741] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:25.382977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218744a3-3b98-40dd-ad83-fb279a857bad None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.437058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 376/742] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:59:25.437883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9d63a-fde5-4e54-a955-99402fb103e3 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.449099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:25.476272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:25.507654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218744a3-3b98-40dd-ad83-fb279a857bad None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:25.552579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5500cb-f198-4776-a505-1b00c09bca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:25.553187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5500cb-f198-4776-a505-1b00c09bca46 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.553468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5500cb-f198-4776-a505-1b00c09bca46 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.553738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5500cb-f198-4776-a505-1b00c09bca46 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.554369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5500cb-f198-4776-a505-1b00c09bca46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:25.554673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5500cb-f198-4776-a505-1b00c09bca46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:25.556685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5500cb-f198-4776-a505-1b00c09bca46 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:25.559064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9d63a-fde5-4e54-a955-99402fb103e3 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:25.570064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 367/743] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:25.570704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5500cb-f198-4776-a505-1b00c09bca46 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.604916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9d041-2356-4f48-87b8-b415f592f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:25.605836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9d041-2356-4f48-87b8-b415f592f93d None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.606041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9d041-2356-4f48-87b8-b415f592f93d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.606302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9d041-2356-4f48-87b8-b415f592f93d None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.606958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9d041-2356-4f48-87b8-b415f592f93d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:25.608344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9d041-2356-4f48-87b8-b415f592f93d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:25.682689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5500cb-f198-4776-a505-1b00c09bca46 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:25.719842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 377/744] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 11:59:25 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:25.719842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9d041-2356-4f48-87b8-b415f592f93d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.721711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:25.729039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1676d0-2b13-43f4-9aaa-a54c589dec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:25.729669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1676d0-2b13-43f4-9aaa-a54c589dec95 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.729966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1676d0-2b13-43f4-9aaa-a54c589dec95 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.730221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1676d0-2b13-43f4-9aaa-a54c589dec95 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.730883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1676d0-2b13-43f4-9aaa-a54c589dec95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:25.731182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1676d0-2b13-43f4-9aaa-a54c589dec95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:25.733531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1676d0-2b13-43f4-9aaa-a54c589dec95 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:25.750748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 368/745] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:25.751663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1676d0-2b13-43f4-9aaa-a54c589dec95 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.805771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:25.839637 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9d041-2356-4f48-87b8-b415f592f93d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:25.869145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1676d0-2b13-43f4-9aaa-a54c589dec95 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:25.880836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054f4ac-b1d7-4cbe-b05a-235ece413c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:25.881490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054f4ac-b1d7-4cbe-b05a-235ece413c61 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.881905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054f4ac-b1d7-4cbe-b05a-235ece413c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.882096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054f4ac-b1d7-4cbe-b05a-235ece413c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.895593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054f4ac-b1d7-4cbe-b05a-235ece413c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:25.897099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054f4ac-b1d7-4cbe-b05a-235ece413c61 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:25.908621 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba5dc-de2f-450d-8899-e8b2338a819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:25.909321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba5dc-de2f-450d-8899-e8b2338a819f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:25.909613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba5dc-de2f-450d-8899-e8b2338a819f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:25.909895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba5dc-de2f-450d-8899-e8b2338a819f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:25.919828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ba5dc-de2f-450d-8899-e8b2338a819f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-e054f4ac-b1d7-4cbe-b05a-235ece413c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:25.920770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:25.921715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:25.922588 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:25.922588 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:25.922588 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:25.922766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ba5dc-de2f-450d-8899-e8b2338a819f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:25.922835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 378/746] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:25.923245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054f4ac-b1d7-4cbe-b05a-235ece413c61 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-9f9ba5dc-de2f-450d-8899-e8b2338a819f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:25.936292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:25.937932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 369/747] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 11:59:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:25.938910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba5dc-de2f-450d-8899-e8b2338a819f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:25.997311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:26.045357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054f4ac-b1d7-4cbe-b05a-235ece413c61 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:26.047815 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba5dc-de2f-450d-8899-e8b2338a819f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:26.068766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:26.079742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a94e8c-7c98-460a-9811-448f5f0280dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:26.080282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a94e8c-7c98-460a-9811-448f5f0280dc None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:26.080556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a94e8c-7c98-460a-9811-448f5f0280dc None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:26.080831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a94e8c-7c98-460a-9811-448f5f0280dc None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:26.081481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a94e8c-7c98-460a-9811-448f5f0280dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:26.082823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a94e8c-7c98-460a-9811-448f5f0280dc None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:26.088295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e208d-0f3c-4420-b986-7faf55342832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:26.088932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e208d-0f3c-4420-b986-7faf55342832 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:26.089217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e208d-0f3c-4420-b986-7faf55342832 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:26.089493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e208d-0f3c-4420-b986-7faf55342832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:26.096636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e208d-0f3c-4420-b986-7faf55342832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:26.098115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e208d-0f3c-4420-b986-7faf55342832 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-c62e208d-0f3c-4420-b986-7faf55342832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:26.110641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:26.111576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 370/748] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:26.117415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e208d-0f3c-4420-b986-7faf55342832 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:26.155660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 379/749] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 11:59:25 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:26.155660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a94e8c-7c98-460a-9811-448f5f0280dc None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:26.235961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e208d-0f3c-4420-b986-7faf55342832 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:26.256337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:26.290739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86250a5-d956-4178-a586-08f2d50304ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:26.291457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86250a5-d956-4178-a586-08f2d50304ed None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:26.291849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86250a5-d956-4178-a586-08f2d50304ed None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:26.292204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86250a5-d956-4178-a586-08f2d50304ed None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:26.293016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86250a5-d956-4178-a586-08f2d50304ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:26.293408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86250a5-d956-4178-a586-08f2d50304ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:26.295093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86250a5-d956-4178-a586-08f2d50304ed None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:26.308030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a94e8c-7c98-460a-9811-448f5f0280dc None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:26.314463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 371/750] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:26.315546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86250a5-d956-4178-a586-08f2d50304ed None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:26.349094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d85ba7-5b31-46fe-8e6d-9bb033e629f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:26.349094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85ba7-5b31-46fe-8e6d-9bb033e629f1 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:26.349094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85ba7-5b31-46fe-8e6d-9bb033e629f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:26.349474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85ba7-5b31-46fe-8e6d-9bb033e629f1 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:26.350045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d85ba7-5b31-46fe-8e6d-9bb033e629f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:26.350354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d85ba7-5b31-46fe-8e6d-9bb033e629f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:26.352431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d85ba7-5b31-46fe-8e6d-9bb033e629f1 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:26.372429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 380/751] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 11:59:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:26.373114 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d85ba7-5b31-46fe-8e6d-9bb033e629f1 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:26.423461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:26.462663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86250a5-d956-4178-a586-08f2d50304ed None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:26.492066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d85ba7-5b31-46fe-8e6d-9bb033e629f1 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:26.510589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01addf94-6912-41c9-b612-a4a56e8e0947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:26.511330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01addf94-6912-41c9-b612-a4a56e8e0947 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:26.511952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01addf94-6912-41c9-b612-a4a56e8e0947 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:26.512300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01addf94-6912-41c9-b612-a4a56e8e0947 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:26.513489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01addf94-6912-41c9-b612-a4a56e8e0947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:26.513870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01addf94-6912-41c9-b612-a4a56e8e0947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:26.515376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01addf94-6912-41c9-b612-a4a56e8e0947 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:26.531401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 372/752] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:26.532550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01addf94-6912-41c9-b612-a4a56e8e0947 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:26.539261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0be72-47ae-4293-abc5-181bac5e4ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:26.540108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0be72-47ae-4293-abc5-181bac5e4ecd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:26.540491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0be72-47ae-4293-abc5-181bac5e4ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:26.540867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0be72-47ae-4293-abc5-181bac5e4ecd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:26.550291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0be72-47ae-4293-abc5-181bac5e4ecd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:26.551969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0be72-47ae-4293-abc5-181bac5e4ecd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:26.564911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-d8e0be72-47ae-4293-abc5-181bac5e4ecd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:26.566903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:26.567974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:26.568929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 381/753] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 11:59:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:26.569579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0be72-47ae-4293-abc5-181bac5e4ecd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:26.669418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01addf94-6912-41c9-b612-a4a56e8e0947 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:26.694366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:26.699829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0be72-47ae-4293-abc5-181bac5e4ecd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:26.717447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4136bc-3940-49b7-9aef-e3cb5b4f6b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:26.718420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4136bc-3940-49b7-9aef-e3cb5b4f6b7d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:26.718941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4136bc-3940-49b7-9aef-e3cb5b4f6b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:26.719483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4136bc-3940-49b7-9aef-e3cb5b4f6b7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:26.744520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adcfaf-cbb6-47aa-a62a-673c128a5e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:26.745058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adcfaf-cbb6-47aa-a62a-673c128a5e06 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:26.745340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adcfaf-cbb6-47aa-a62a-673c128a5e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:26.745617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adcfaf-cbb6-47aa-a62a-673c128a5e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:26.746398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adcfaf-cbb6-47aa-a62a-673c128a5e06 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=063f7bf74f444c14b9bf6c0ca936dd12) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:26.746719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adcfaf-cbb6-47aa-a62a-673c128a5e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:26.748223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adcfaf-cbb6-47aa-a62a-673c128a5e06 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:26.761223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 382/754] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:26 2022] GET /identity/v3/role_assignments?user.id=063f7bf74f444c14b9bf6c0ca936dd12&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=06592016669243d99b430c46dd1c1d46 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:26.761223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adcfaf-cbb6-47aa-a62a-673c128a5e06 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:26.857451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4136bc-3940-49b7-9aef-e3cb5b4f6b7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:26.858914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4136bc-3940-49b7-9aef-e3cb5b4f6b7d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:26.920823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:26.978417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adcfaf-cbb6-47aa-a62a-673c128a5e06 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:27.031073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 373/755] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:27.041383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4136bc-3940-49b7-9aef-e3cb5b4f6b7d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:27.145800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac068f-a39c-46e3-89d3-1c772318c68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:27.146798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac068f-a39c-46e3-89d3-1c772318c68f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:27.147311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac068f-a39c-46e3-89d3-1c772318c68f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:27.147831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac068f-a39c-46e3-89d3-1c772318c68f None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:27.148794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac068f-a39c-46e3-89d3-1c772318c68f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:27.149396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac068f-a39c-46e3-89d3-1c772318c68f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:27.151082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac068f-a39c-46e3-89d3-1c772318c68f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:27.172235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 383/756] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 11:59:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:27.178219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac068f-a39c-46e3-89d3-1c772318c68f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:27.225379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:27.281863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4136bc-3940-49b7-9aef-e3cb5b4f6b7d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:27.313948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac068f-a39c-46e3-89d3-1c772318c68f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:27.346111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:27.354739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80d253-98be-4068-acb4-d9ff809e487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:27.355382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d253-98be-4068-acb4-d9ff809e487a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:27.355700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d253-98be-4068-acb4-d9ff809e487a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:27.355962 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d253-98be-4068-acb4-d9ff809e487a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:27.361686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de477b3-4f6c-49bd-8f7c-808adc17140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:27.362332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de477b3-4f6c-49bd-8f7c-808adc17140a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:27.362620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de477b3-4f6c-49bd-8f7c-808adc17140a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:27.362896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de477b3-4f6c-49bd-8f7c-808adc17140a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:27.379130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d253-98be-4068-acb4-d9ff809e487a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:27.380619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d253-98be-4068-acb4-d9ff809e487a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:27.384014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de477b3-4f6c-49bd-8f7c-808adc17140a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:27.385466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de477b3-4f6c-49bd-8f7c-808adc17140a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-5de477b3-4f6c-49bd-8f7c-808adc17140a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:27.401326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:27.402344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:27.403248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:27.403248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:27.403248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:27.403248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 374/757] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-7e80d253-98be-4068-acb4-d9ff809e487a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:27.404303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:27.405191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:27.406109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:27.406109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:27.406109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:27.406109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 384/758] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:27.408584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de477b3-4f6c-49bd-8f7c-808adc17140a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:27.412516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80d253-98be-4068-acb4-d9ff809e487a None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:27.560542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de477b3-4f6c-49bd-8f7c-808adc17140a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:27.584467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:27.601128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e3b5c-d803-47d3-9d49-2203411a64c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:27.601894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e3b5c-d803-47d3-9d49-2203411a64c1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:27.602186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e3b5c-d803-47d3-9d49-2203411a64c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:27.602505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e3b5c-d803-47d3-9d49-2203411a64c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:27.603686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e3b5c-d803-47d3-9d49-2203411a64c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:27.603996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e3b5c-d803-47d3-9d49-2203411a64c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:27.605557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e3b5c-d803-47d3-9d49-2203411a64c1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:27.624634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 375/759] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:27.626662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e3b5c-d803-47d3-9d49-2203411a64c1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:27.647117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80d253-98be-4068-acb4-d9ff809e487a None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:27.683526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fc558-8ad4-486b-8ea8-93ef8a6a779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:27.684166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fc558-8ad4-486b-8ea8-93ef8a6a779f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:27.684447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fc558-8ad4-486b-8ea8-93ef8a6a779f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:27.684722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fc558-8ad4-486b-8ea8-93ef8a6a779f None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:27.685368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fc558-8ad4-486b-8ea8-93ef8a6a779f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:27.685676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fc558-8ad4-486b-8ea8-93ef8a6a779f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:27.687030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fc558-8ad4-486b-8ea8-93ef8a6a779f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:27.700340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 385/760] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:27.707912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fc558-8ad4-486b-8ea8-93ef8a6a779f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:27.730616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:27.806185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e3b5c-d803-47d3-9d49-2203411a64c1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:27.853495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00a5b-748f-479e-825f-4ebba1d3c17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:27.854609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00a5b-748f-479e-825f-4ebba1d3c17f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:27.855108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00a5b-748f-479e-825f-4ebba1d3c17f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:27.857181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00a5b-748f-479e-825f-4ebba1d3c17f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:27.875189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fc558-8ad4-486b-8ea8-93ef8a6a779f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:27.880504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00a5b-748f-479e-825f-4ebba1d3c17f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:27.882595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00a5b-748f-479e-825f-4ebba1d3c17f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:27.923298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5ff2c-8f4b-4fbf-b0d9-b4169973555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:27.923298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5ff2c-8f4b-4fbf-b0d9-b4169973555c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:27.923298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5ff2c-8f4b-4fbf-b0d9-b4169973555c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:27.923298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5ff2c-8f4b-4fbf-b0d9-b4169973555c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:27.923751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-0fd00a5b-748f-479e-825f-4ebba1d3c17f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:27.924953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:27.925806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:27.926711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:27.926711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:27.926711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:27.926711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:27.926711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:27.926711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:27.926711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:27.926711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:27.927162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5ff2c-8f4b-4fbf-b0d9-b4169973555c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:27.927677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5ff2c-8f4b-4fbf-b0d9-b4169973555c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:27.929173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 376/761] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:27.935708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00a5b-748f-479e-825f-4ebba1d3c17f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-6cb5ff2c-8f4b-4fbf-b0d9-b4169973555c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:27.956883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:27.957792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:27.958700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:27.958700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:27.958700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:27.958700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:27.958700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:27.958700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:27.958700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:27.958700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:27.962713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 386/762] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:27.964027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5ff2c-8f4b-4fbf-b0d9-b4169973555c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:28.119734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5ff2c-8f4b-4fbf-b0d9-b4169973555c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:28.206825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05461435-b4bf-4696-9d24-f23529d511a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:28.207451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05461435-b4bf-4696-9d24-f23529d511a5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:28.207754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05461435-b4bf-4696-9d24-f23529d511a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:28.208034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05461435-b4bf-4696-9d24-f23529d511a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:28.208729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05461435-b4bf-4696-9d24-f23529d511a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:28.209033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05461435-b4bf-4696-9d24-f23529d511a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:28.220903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05461435-b4bf-4696-9d24-f23529d511a5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:28.245010 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:28.249547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 387/763] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:28.250400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00a5b-748f-479e-825f-4ebba1d3c17f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:28.252156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ae56-996c-4fae-b39c-a67b3faa6d78 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:28.253979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ae56-996c-4fae-b39c-a67b3faa6d78 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:28.254284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ae56-996c-4fae-b39c-a67b3faa6d78 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:28.260436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 388/764] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:28.264281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ae56-996c-4fae-b39c-a67b3faa6d78 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:28.320592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e1576-9d62-493e-bcb8-dae4ffb616c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:28.321748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e1576-9d62-493e-bcb8-dae4ffb616c0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:28.323338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e1576-9d62-493e-bcb8-dae4ffb616c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:28.324314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e1576-9d62-493e-bcb8-dae4ffb616c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:28.325702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e1576-9d62-493e-bcb8-dae4ffb616c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:28.326269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e1576-9d62-493e-bcb8-dae4ffb616c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:28.328486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e1576-9d62-493e-bcb8-dae4ffb616c0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:28.350855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 377/765] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:28.355193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab67f9c-2bcd-4aa6-92ed-1cd493e91d28 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:28.355907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab67f9c-2bcd-4aa6-92ed-1cd493e91d28 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:28.356814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab67f9c-2bcd-4aa6-92ed-1cd493e91d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:28.387590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-9ab67f9c-2bcd-4aa6-92ed-1cd493e91d28 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:28.389525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9ab67f9c-2bcd-4aa6-92ed-1cd493e91d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:28.404660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:28.488074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 378/766] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:28.489516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab67f9c-2bcd-4aa6-92ed-1cd493e91d28 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:28.499169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ae56-996c-4fae-b39c-a67b3faa6d78 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:28.583420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c2032-0a8f-46f0-ba59-e34312061f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:28.584514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2032-0a8f-46f0-ba59-e34312061f53 None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:28.585076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2032-0a8f-46f0-ba59-e34312061f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:28.585609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2032-0a8f-46f0-ba59-e34312061f53 None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/4971acb91bbf498887606c5ba5d00176/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:28.592713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c2032-0a8f-46f0-ba59-e34312061f53 None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=4971acb91bbf498887606c5ba5d00176, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:28.594733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c2032-0a8f-46f0-ba59-e34312061f53 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:28.687782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:28.698350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab67f9c-2bcd-4aa6-92ed-1cd493e91d28 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:28.710961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 389/767] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:59:28 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/4971acb91bbf498887606c5ba5d00176/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:59:28.736608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fbf1a-3cc5-49e5-ad14-54257825105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:28.737302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fbf1a-3cc5-49e5-ad14-54257825105c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:28.737586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fbf1a-3cc5-49e5-ad14-54257825105c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:28.737858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fbf1a-3cc5-49e5-ad14-54257825105c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:28.738704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fbf1a-3cc5-49e5-ad14-54257825105c None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=18bd4f37058e4019a1e5f13dfdcdc4ac) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:28.739024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fbf1a-3cc5-49e5-ad14-54257825105c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:28.740514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fbf1a-3cc5-49e5-ad14-54257825105c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:28.747364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 379/768] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:28 2022] GET /identity/v3/role_assignments?user.id=18bd4f37058e4019a1e5f13dfdcdc4ac&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:28.763556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb30e7-84d8-4568-8b2c-bab4c7cc0f00 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:28.763970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb30e7-84d8-4568-8b2c-bab4c7cc0f00 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:28.764262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb30e7-84d8-4568-8b2c-bab4c7cc0f00 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:28.765975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 390/769] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:28.773762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53cca-fd73-4832-94b9-83e74e3bcda3 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:28.774090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53cca-fd73-4832-94b9-83e74e3bcda3 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:28.774324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53cca-fd73-4832-94b9-83e74e3bcda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:28.795186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-c7e53cca-fd73-4832-94b9-83e74e3bcda3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:28.796462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c7e53cca-fd73-4832-94b9-83e74e3bcda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:28.838996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb30e7-84d8-4568-8b2c-bab4c7cc0f00 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:28.886172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 380/770] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:29.005778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb30e7-84d8-4568-8b2c-bab4c7cc0f00 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:29.028750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:29.046834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fabaeb-c0fa-4097-8e3c-d7b6b09c21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:29.047479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fabaeb-c0fa-4097-8e3c-d7b6b09c21c2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:29.047849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fabaeb-c0fa-4097-8e3c-d7b6b09c21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:29.048124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fabaeb-c0fa-4097-8e3c-d7b6b09c21c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:29.048712 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fabaeb-c0fa-4097-8e3c-d7b6b09c21c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:29.050067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fabaeb-c0fa-4097-8e3c-d7b6b09c21c2 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-30fabaeb-c0fa-4097-8e3c-d7b6b09c21c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:29.060230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:29.061238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:29.062176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 391/771] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Sep 9 11:59:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:29.068083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e53cca-fd73-4832-94b9-83e74e3bcda3 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:29.207248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:29.229219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fabaeb-c0fa-4097-8e3c-d7b6b09c21c2 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:29.231842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e53cca-fd73-4832-94b9-83e74e3bcda3 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:29.278696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcf280-01da-43b7-a2d5-909682ee899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:29.279568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcf280-01da-43b7-a2d5-909682ee899f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:29.279889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcf280-01da-43b7-a2d5-909682ee899f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:29.280171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcf280-01da-43b7-a2d5-909682ee899f None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:29.280822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcf280-01da-43b7-a2d5-909682ee899f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:29.281133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcf280-01da-43b7-a2d5-909682ee899f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:29.282544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcf280-01da-43b7-a2d5-909682ee899f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:29.293095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 381/772] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 11:59:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:29.294593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcf280-01da-43b7-a2d5-909682ee899f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:29.396919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fabaeb-c0fa-4097-8e3c-d7b6b09c21c2 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:29.416820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcf280-01da-43b7-a2d5-909682ee899f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:29.436607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f6814-92d4-497e-9710-60b9edd2c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:29.437566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f6814-92d4-497e-9710-60b9edd2c178 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:29.437852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f6814-92d4-497e-9710-60b9edd2c178 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:29.438124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f6814-92d4-497e-9710-60b9edd2c178 None admin] PATH_INFO: `/v3/services/network` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:29.438975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f6814-92d4-497e-9710-60b9edd2c178 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:29.440783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f6814-92d4-497e-9710-60b9edd2c178 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-c32f6814-92d4-497e-9710-60b9edd2c178 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:29.453803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:29.454854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:59:29.455715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:29.459726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 392/773] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:29 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:29.461082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3446-f602-44c5-a94c-48f4c6a75786 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:29.461369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3446-f602-44c5-a94c-48f4c6a75786 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:29.461648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3446-f602-44c5-a94c-48f4c6a75786 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:29.463127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 393/774] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:29.464537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3446-f602-44c5-a94c-48f4c6a75786 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:29.465763 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c6ce-eaca-4ae1-a6a7-70841cb45c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:29.466393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c6ce-eaca-4ae1-a6a7-70841cb45c8f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:29.466673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c6ce-eaca-4ae1-a6a7-70841cb45c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:29.466948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c6ce-eaca-4ae1-a6a7-70841cb45c8f None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:29.467657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88c6ce-eaca-4ae1-a6a7-70841cb45c8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:29.467975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88c6ce-eaca-4ae1-a6a7-70841cb45c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:29.469455 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88c6ce-eaca-4ae1-a6a7-70841cb45c8f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:29.477472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 382/775] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 11:59:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:29.478335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a77370-524e-4e4a-9885-0880074231c2 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:29.478637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a77370-524e-4e4a-9885-0880074231c2 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:29.478919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a77370-524e-4e4a-9885-0880074231c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:29.503913 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a2a77370-524e-4e4a-9885-0880074231c2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:29.505113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a2a77370-524e-4e4a-9885-0880074231c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:29.519743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:29.535331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:29.597126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3446-f602-44c5-a94c-48f4c6a75786 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:29.615650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 383/776] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:29.615650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a77370-524e-4e4a-9885-0880074231c2 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:29.663199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98a55c-b3cc-4af9-99ab-695c909c1b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:29.663842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98a55c-b3cc-4af9-99ab-695c909c1b3b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:29.664125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98a55c-b3cc-4af9-99ab-695c909c1b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:29.664405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98a55c-b3cc-4af9-99ab-695c909c1b3b None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:29.665099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98a55c-b3cc-4af9-99ab-695c909c1b3b None admin] RBAC: Adding query filter params (name=network) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:29.665923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98a55c-b3cc-4af9-99ab-695c909c1b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:29.667301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98a55c-b3cc-4af9-99ab-695c909c1b3b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:29.679851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 394/777] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:29.688796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98a55c-b3cc-4af9-99ab-695c909c1b3b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:29.759739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a77370-524e-4e4a-9885-0880074231c2 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:29.814884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb142-976e-4f9a-a5a9-f7e7e09ef4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:29.815877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb142-976e-4f9a-a5a9-f7e7e09ef4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:29.816362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb142-976e-4f9a-a5a9-f7e7e09ef4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:29.816869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb142-976e-4f9a-a5a9-f7e7e09ef4e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:29.817942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb142-976e-4f9a-a5a9-f7e7e09ef4e6 None admin] RBAC: Adding query filter params (interface=public, service_id=c39a0b3da23e48f8b1db8b78004a25ab, region_id=RegionOne) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:29.818453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb142-976e-4f9a-a5a9-f7e7e09ef4e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:29.820058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb142-976e-4f9a-a5a9-f7e7e09ef4e6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:29.827314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98a55c-b3cc-4af9-99ab-695c909c1b3b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:29.832663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:29.843085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 384/778] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 11:59:29 2022] GET /identity/v3/endpoints?service_id=c39a0b3da23e48f8b1db8b78004a25ab&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:29.848986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb142-976e-4f9a-a5a9-f7e7e09ef4e6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:29.863684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:29.874041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab774b-c383-4281-bd65-10b6745e400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:29.874950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab774b-c383-4281-bd65-10b6745e400e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:29.875406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab774b-c383-4281-bd65-10b6745e400e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:29.876104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab774b-c383-4281-bd65-10b6745e400e None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:29.876907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab774b-c383-4281-bd65-10b6745e400e None admin] RBAC: Adding query filter params (type=network) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:29.877360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab774b-c383-4281-bd65-10b6745e400e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:29.878913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab774b-c383-4281-bd65-10b6745e400e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:29.885610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 395/779] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:29.891253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab774b-c383-4281-bd65-10b6745e400e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:30.012656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab774b-c383-4281-bd65-10b6745e400e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:30.026678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb142-976e-4f9a-a5a9-f7e7e09ef4e6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:30.054432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bd189-0a82-45d7-bfa4-6031a2d1c4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:30.055042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bd189-0a82-45d7-bfa4-6031a2d1c4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:30.055335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bd189-0a82-45d7-bfa4-6031a2d1c4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:30.055598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bd189-0a82-45d7-bfa4-6031a2d1c4c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:30.056340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bd189-0a82-45d7-bfa4-6031a2d1c4c2 None admin] RBAC: Adding query filter params (interface=public, service_id=17b517b1655b4560a44b3e47abf06ae9, region_id=RegionOne) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:30.056650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bd189-0a82-45d7-bfa4-6031a2d1c4c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:30.058375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bd189-0a82-45d7-bfa4-6031a2d1c4c2 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:30.063281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ffd9e-1a24-4290-ab49-a975df6924c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:30.064146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ffd9e-1a24-4290-ab49-a975df6924c3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:30.064629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ffd9e-1a24-4290-ab49-a975df6924c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:30.065158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ffd9e-1a24-4290-ab49-a975df6924c3 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:30.065940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ffd9e-1a24-4290-ab49-a975df6924c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:30.067358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 396/780] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 11:59:29 2022] GET /identity/v3/endpoints?service_id=17b517b1655b4560a44b3e47abf06ae9&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:30.067837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ffd9e-1a24-4290-ab49-a975df6924c3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:30.068254 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bd189-0a82-45d7-bfa4-6031a2d1c4c2 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:30.074846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 385/781] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 11:59:29 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:30.075958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ffd9e-1a24-4290-ab49-a975df6924c3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:30.127233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:30.182114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:30.246548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ffd9e-1a24-4290-ab49-a975df6924c3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:30.256827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bd189-0a82-45d7-bfa4-6031a2d1c4c2 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:30.297146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d01eb-24b8-4717-891e-8d570157c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:30.297795 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d01eb-24b8-4717-891e-8d570157c7fd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:30.298221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d01eb-24b8-4717-891e-8d570157c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:30.298501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d01eb-24b8-4717-891e-8d570157c7fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:30.310523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d01eb-24b8-4717-891e-8d570157c7fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:30.312202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8b599-08ea-4dee-8470-970754a34aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:30.312825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8b599-08ea-4dee-8470-970754a34aec None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:30.313115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8b599-08ea-4dee-8470-970754a34aec None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:30.313395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8b599-08ea-4dee-8470-970754a34aec None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:30.314003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8b599-08ea-4dee-8470-970754a34aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:30.315441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8b599-08ea-4dee-8470-970754a34aec None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-582d01eb-24b8-4717-891e-8d570157c7fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:30.315824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:30.316764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:30.317621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:30.318273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 397/782] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:30.321152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 386/783] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 11:59:30 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:30.325622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d01eb-24b8-4717-891e-8d570157c7fd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:30.470718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:30.483096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d01eb-24b8-4717-891e-8d570157c7fd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:30.535076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201ebb3-7f10-464c-9d11-9ee3fc0f1ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:30.536037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201ebb3-7f10-464c-9d11-9ee3fc0f1ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:30.536531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201ebb3-7f10-464c-9d11-9ee3fc0f1ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:30.536984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201ebb3-7f10-464c-9d11-9ee3fc0f1ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:30.537843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201ebb3-7f10-464c-9d11-9ee3fc0f1ff4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:30.538326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201ebb3-7f10-464c-9d11-9ee3fc0f1ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:30.539896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201ebb3-7f10-464c-9d11-9ee3fc0f1ff4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:30.554369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 398/784] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:30.560552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8b599-08ea-4dee-8470-970754a34aec None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:30.670989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8b599-08ea-4dee-8470-970754a34aec None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:30.710132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9336bb-5ea1-4027-b80b-f9dbb532683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:30.711170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9336bb-5ea1-4027-b80b-f9dbb532683a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:30.711705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9336bb-5ea1-4027-b80b-f9dbb532683a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:30.712747 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9336bb-5ea1-4027-b80b-f9dbb532683a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:30.716186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:30.725769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9336bb-5ea1-4027-b80b-f9dbb532683a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:30.727642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9336bb-5ea1-4027-b80b-f9dbb532683a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-ef9336bb-5ea1-4027-b80b-f9dbb532683a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:30.746131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:30.747252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:30.748198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:30.748198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:30.748198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:30.749818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 387/785] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:30.756053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201ebb3-7f10-464c-9d11-9ee3fc0f1ff4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:30.882192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201ebb3-7f10-464c-9d11-9ee3fc0f1ff4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:30.922659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cf072-a5c1-4bf9-a464-af62c145f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:30.923202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cf072-a5c1-4bf9-a464-af62c145f559 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:30.923483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cf072-a5c1-4bf9-a464-af62c145f559 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:30.923787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cf072-a5c1-4bf9-a464-af62c145f559 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:30.924451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cf072-a5c1-4bf9-a464-af62c145f559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:30.924760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cf072-a5c1-4bf9-a464-af62c145f559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:30.926130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cf072-a5c1-4bf9-a464-af62c145f559 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:30.939578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 399/786] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:30.945414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9336bb-5ea1-4027-b80b-f9dbb532683a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:31.099715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9336bb-5ea1-4027-b80b-f9dbb532683a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:31.160036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5867c0-a973-4ebd-bd5e-c3ecc9ffea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:31.161064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5867c0-a973-4ebd-bd5e-c3ecc9ffea34 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:31.161555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5867c0-a973-4ebd-bd5e-c3ecc9ffea34 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:31.162054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5867c0-a973-4ebd-bd5e-c3ecc9ffea34 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:31.173828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5867c0-a973-4ebd-bd5e-c3ecc9ffea34 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:31.175587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5867c0-a973-4ebd-bd5e-c3ecc9ffea34 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-8e5867c0-a973-4ebd-bd5e-c3ecc9ffea34 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:31.187086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:31.188094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:31.189052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:31.191576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 388/787] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:31.199031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cf072-a5c1-4bf9-a464-af62c145f559 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:31.227304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:31.334810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cf072-a5c1-4bf9-a464-af62c145f559 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:31.385543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2568-7ac8-4292-93f9-9aba7d1c34c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:31.386191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2568-7ac8-4292-93f9-9aba7d1c34c0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:31.386508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2568-7ac8-4292-93f9-9aba7d1c34c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:31.386796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2568-7ac8-4292-93f9-9aba7d1c34c0 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:31.387591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b2568-7ac8-4292-93f9-9aba7d1c34c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:31.387933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b2568-7ac8-4292-93f9-9aba7d1c34c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:31.389430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b2568-7ac8-4292-93f9-9aba7d1c34c0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:31.419967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 400/788] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 11:59:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:31.426275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5867c0-a973-4ebd-bd5e-c3ecc9ffea34 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:31.491139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8137f-ae18-4782-8b99-b4421d725475 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:31.491458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8137f-ae18-4782-8b99-b4421d725475 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:31.491730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8137f-ae18-4782-8b99-b4421d725475 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:31.493948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 401/789] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:31.500316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00073f-290b-4db7-8d75-0867ee94ddd6 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:31.500862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00073f-290b-4db7-8d75-0867ee94ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:31.501146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00073f-290b-4db7-8d75-0867ee94ddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:31.511778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:31.519707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9f00073f-290b-4db7-8d75-0867ee94ddd6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:31.520930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9f00073f-290b-4db7-8d75-0867ee94ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:31.600478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5867c0-a973-4ebd-bd5e-c3ecc9ffea34 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:31.627601 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 402/790] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:31.630019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6d7f-6325-4d3b-afa1-03a5e42c9e9b None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:31.630549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6d7f-6325-4d3b-afa1-03a5e42c9e9b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:31.631030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6d7f-6325-4d3b-afa1-03a5e42c9e9b None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:31.632863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 403/791] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:31.641937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050aad1-50cb-4b04-a7c6-6ab34b5f2843 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:31.642536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050aad1-50cb-4b04-a7c6-6ab34b5f2843 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:31.643139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050aad1-50cb-4b04-a7c6-6ab34b5f2843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:31.646129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16028288-d1bb-4630-8ee5-5461ffe2c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:31.646930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16028288-d1bb-4630-8ee5-5461ffe2c4fb None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:31.651682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16028288-d1bb-4630-8ee5-5461ffe2c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:31.651682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16028288-d1bb-4630-8ee5-5461ffe2c4fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:31.662202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:31.685307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-0050aad1-50cb-4b04-a7c6-6ab34b5f2843 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:31.691871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0050aad1-50cb-4b04-a7c6-6ab34b5f2843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:31.806055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 404/792] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:31.820260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16028288-d1bb-4630-8ee5-5461ffe2c4fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:31.822113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16028288-d1bb-4630-8ee5-5461ffe2c4fb None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-16028288-d1bb-4630-8ee5-5461ffe2c4fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:31.838000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:31.838987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:31.839979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:31.839979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:31.839979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:31.841994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 389/793] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:31.848715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050aad1-50cb-4b04-a7c6-6ab34b5f2843 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:31.965602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050aad1-50cb-4b04-a7c6-6ab34b5f2843 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.002203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac5f3d-a0e3-4bd7-8133-75676005a093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.003179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac5f3d-a0e3-4bd7-8133-75676005a093 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.003700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac5f3d-a0e3-4bd7-8133-75676005a093 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.004202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac5f3d-a0e3-4bd7-8133-75676005a093 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.005085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac5f3d-a0e3-4bd7-8133-75676005a093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:32.005599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac5f3d-a0e3-4bd7-8133-75676005a093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:32.007207 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac5f3d-a0e3-4bd7-8133-75676005a093 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:32.009252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:32.021385 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 405/794] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:32.027598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16028288-d1bb-4630-8ee5-5461ffe2c4fb None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.039710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac5f3d-a0e3-4bd7-8133-75676005a093 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.179505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac5f3d-a0e3-4bd7-8133-75676005a093 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.183866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:32.188979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16028288-d1bb-4630-8ee5-5461ffe2c4fb None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.217152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03459ad-1604-430b-8445-e241031fd048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.218157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03459ad-1604-430b-8445-e241031fd048 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.218678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03459ad-1604-430b-8445-e241031fd048 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.219153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03459ad-1604-430b-8445-e241031fd048 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.229997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03459ad-1604-430b-8445-e241031fd048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:32.232533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a7523-5206-470e-b6b0-52c6d7196ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.233179 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a7523-5206-470e-b6b0-52c6d7196ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.233446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a7523-5206-470e-b6b0-52c6d7196ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.233717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a7523-5206-470e-b6b0-52c6d7196ab9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-c03459ad-1604-430b-8445-e241031fd048 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:32.236852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:32.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:32.238606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:32.240928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a7523-5206-470e-b6b0-52c6d7196ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:32.241439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 406/795] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:32.242295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a7523-5206-470e-b6b0-52c6d7196ab9 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:32.242658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03459ad-1604-430b-8445-e241031fd048 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-747a7523-5206-470e-b6b0-52c6d7196ab9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:32.263198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:32.264182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 390/796] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:32.270073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a7523-5206-470e-b6b0-52c6d7196ab9 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.318282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:32.376520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03459ad-1604-430b-8445-e241031fd048 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.393217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a7523-5206-470e-b6b0-52c6d7196ab9 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.415579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7ab1b-574a-483f-a1ed-8f452b4e7a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.416769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7ab1b-574a-483f-a1ed-8f452b4e7a50 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.417267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7ab1b-574a-483f-a1ed-8f452b4e7a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.417823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7ab1b-574a-483f-a1ed-8f452b4e7a50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.428306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad665284-0265-4ace-81b3-e37a89158d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.428929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad665284-0265-4ace-81b3-e37a89158d17 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.429249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad665284-0265-4ace-81b3-e37a89158d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.429655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad665284-0265-4ace-81b3-e37a89158d17 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.430315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad665284-0265-4ace-81b3-e37a89158d17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:32.430621 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad665284-0265-4ace-81b3-e37a89158d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:32.430949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7ab1b-574a-483f-a1ed-8f452b4e7a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:32.432098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad665284-0265-4ace-81b3-e37a89158d17 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-3bb7ab1b-574a-483f-a1ed-8f452b4e7a50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:32.437239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:32.438194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:32.439067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:32.445748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 407/797] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:32.446015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 391/798] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:32.447427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad665284-0265-4ace-81b3-e37a89158d17 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.447832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7ab1b-574a-483f-a1ed-8f452b4e7a50 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.471196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:32.566836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad665284-0265-4ace-81b3-e37a89158d17 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.569543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7ab1b-574a-483f-a1ed-8f452b4e7a50 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.587349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:32.607129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a6423-515c-4db0-a71c-a081c46b4c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.608064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a6423-515c-4db0-a71c-a081c46b4c71 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.608497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a6423-515c-4db0-a71c-a081c46b4c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.608920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a6423-515c-4db0-a71c-a081c46b4c71 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.609865 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a6423-515c-4db0-a71c-a081c46b4c71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:32.610335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a6423-515c-4db0-a71c-a081c46b4c71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:32.611075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba709-d64a-4840-9338-40d7f2d2eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.611739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba709-d64a-4840-9338-40d7f2d2eca3 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.612067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba709-d64a-4840-9338-40d7f2d2eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.612340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba709-d64a-4840-9338-40d7f2d2eca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.612679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a6423-515c-4db0-a71c-a081c46b4c71 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:32.626342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ba709-d64a-4840-9338-40d7f2d2eca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:32.627502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 392/799] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:32.627953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ba709-d64a-4840-9338-40d7f2d2eca3 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:32.628893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a6423-515c-4db0-a71c-a081c46b4c71 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-fb8ba709-d64a-4840-9338-40d7f2d2eca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:32.646667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:32.647757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:32.648852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:32.648852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:32.648852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:32.651696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 408/800] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:32.652704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba709-d64a-4840-9338-40d7f2d2eca3 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.723426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:32.744010 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a6423-515c-4db0-a71c-a081c46b4c71 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.764198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba709-d64a-4840-9338-40d7f2d2eca3 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.781259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9def8-5e72-4bec-b879-e64498cee963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.781859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9def8-5e72-4bec-b879-e64498cee963 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.782137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9def8-5e72-4bec-b879-e64498cee963 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.782405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9def8-5e72-4bec-b879-e64498cee963 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.783057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9def8-5e72-4bec-b879-e64498cee963 None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:32.783470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9def8-5e72-4bec-b879-e64498cee963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:32.784924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9def8-5e72-4bec-b879-e64498cee963 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:32.798121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 393/801] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:32.798121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9def8-5e72-4bec-b879-e64498cee963 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.802638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ace1d-4ecf-45cf-993d-53dff00a75a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.803319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ace1d-4ecf-45cf-993d-53dff00a75a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.803599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ace1d-4ecf-45cf-993d-53dff00a75a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.805619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ace1d-4ecf-45cf-993d-53dff00a75a5 None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/063f7bf74f444c14b9bf6c0ca936dd12/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.807557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ace1d-4ecf-45cf-993d-53dff00a75a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=063f7bf74f444c14b9bf6c0ca936dd12, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:32.809028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ace1d-4ecf-45cf-993d-53dff00a75a5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:32.888359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 409/802] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:59:32 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/063f7bf74f444c14b9bf6c0ca936dd12/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:59:32.890159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485dd1-ca69-487c-8fd4-5d7962c91b0d None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.890548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485dd1-ca69-487c-8fd4-5d7962c91b0d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.890934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485dd1-ca69-487c-8fd4-5d7962c91b0d None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.892585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 410/803] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:32.893300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485dd1-ca69-487c-8fd4-5d7962c91b0d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:32.914302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9def8-5e72-4bec-b879-e64498cee963 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:32.927755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:32.970518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ab3ce-2a93-4e62-bd4c-f0e143474c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:32.972149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab3ce-2a93-4e62-bd4c-f0e143474c5c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:32.972726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab3ce-2a93-4e62-bd4c-f0e143474c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:32.973248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab3ce-2a93-4e62-bd4c-f0e143474c5c None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:32.974414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ab3ce-2a93-4e62-bd4c-f0e143474c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:32.975561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ab3ce-2a93-4e62-bd4c-f0e143474c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:32.978449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ab3ce-2a93-4e62-bd4c-f0e143474c5c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.004671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 394/804] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:33.005551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cc103-f789-4b18-ae6d-6a66797f22bb None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.005849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cc103-f789-4b18-ae6d-6a66797f22bb None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.006128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cc103-f789-4b18-ae6d-6a66797f22bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.013272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:33.028619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-305cc103-f789-4b18-ae6d-6a66797f22bb None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:33.030082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-305cc103-f789-4b18-ae6d-6a66797f22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:33.039893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485dd1-ca69-487c-8fd4-5d7962c91b0d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:33.093587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66632d21-424c-4a5e-9c94-4bbfe1d836d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:33.094229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66632d21-424c-4a5e-9c94-4bbfe1d836d4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.094514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66632d21-424c-4a5e-9c94-4bbfe1d836d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.094788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66632d21-424c-4a5e-9c94-4bbfe1d836d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.106880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66632d21-424c-4a5e-9c94-4bbfe1d836d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:33.108366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66632d21-424c-4a5e-9c94-4bbfe1d836d4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.112098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 395/805] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:33.113184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cc103-f789-4b18-ae6d-6a66797f22bb None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-66632d21-424c-4a5e-9c94-4bbfe1d836d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:33.127800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:33.128769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:33.129663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:33.129663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:33.129663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:33.131264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 411/806] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:33.137289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31d08c-1627-4be1-994d-9b0069e82e7d None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.137772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31d08c-1627-4be1-994d-9b0069e82e7d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.138250 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31d08c-1627-4be1-994d-9b0069e82e7d None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.140037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 412/807] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:33.141662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31d08c-1627-4be1-994d-9b0069e82e7d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:33.236977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:33.240839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cc103-f789-4b18-ae6d-6a66797f22bb None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:33.262043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31d08c-1627-4be1-994d-9b0069e82e7d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:33.282092 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:33.289359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac848d82-19d8-433d-bff1-c36dd9ad5d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:33.290867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac848d82-19d8-433d-bff1-c36dd9ad5d64 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.291453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac848d82-19d8-433d-bff1-c36dd9ad5d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.292241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac848d82-19d8-433d-bff1-c36dd9ad5d64 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.301355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fade9da-b5ea-4a59-b03a-8dae8483ab0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:33.302422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade9da-b5ea-4a59-b03a-8dae8483ab0a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.303262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade9da-b5ea-4a59-b03a-8dae8483ab0a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.303767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac848d82-19d8-433d-bff1-c36dd9ad5d64 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:33.304140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade9da-b5ea-4a59-b03a-8dae8483ab0a None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.305924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fade9da-b5ea-4a59-b03a-8dae8483ab0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:33.306331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fade9da-b5ea-4a59-b03a-8dae8483ab0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:33.306768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac848d82-19d8-433d-bff1-c36dd9ad5d64 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.307930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fade9da-b5ea-4a59-b03a-8dae8483ab0a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.325530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 413/808] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:33.325530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2991b8-64fd-480b-b305-2bd303ad4b51 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.325530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2991b8-64fd-480b-b305-2bd303ad4b51 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.325530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2991b8-64fd-480b-b305-2bd303ad4b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-ac848d82-19d8-433d-bff1-c36dd9ad5d64 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:33.327203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:33.328173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:59:33.329115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:33.330985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 396/809] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 11:59:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:33.331928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac848d82-19d8-433d-bff1-c36dd9ad5d64 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:33.349291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2b2991b8-64fd-480b-b305-2bd303ad4b51 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:33.350711 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2b2991b8-64fd-480b-b305-2bd303ad4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:33.432524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 414/810] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:33.433238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2991b8-64fd-480b-b305-2bd303ad4b51 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:33.456802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac848d82-19d8-433d-bff1-c36dd9ad5d64 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:33.505297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8ae3-c047-47d1-a5ea-1fdd69ae9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:33.506149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:33.507236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8ae3-c047-47d1-a5ea-1fdd69ae9c65 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.507720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8ae3-c047-47d1-a5ea-1fdd69ae9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.508428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8ae3-c047-47d1-a5ea-1fdd69ae9c65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.518451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca8ae3-c047-47d1-a5ea-1fdd69ae9c65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:33.520699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca8ae3-c047-47d1-a5ea-1fdd69ae9c65 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-d2ca8ae3-c047-47d1-a5ea-1fdd69ae9c65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:33.537021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:33.538127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:33.539108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:33.541152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 397/811] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 11:59:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:33.541152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8ae3-c047-47d1-a5ea-1fdd69ae9c65 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:33.555124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2991b8-64fd-480b-b305-2bd303ad4b51 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:33.593187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b098a8-4322-425a-93f8-adbabc7b2967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:33.593804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b098a8-4322-425a-93f8-adbabc7b2967 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.594122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b098a8-4322-425a-93f8-adbabc7b2967 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.594394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b098a8-4322-425a-93f8-adbabc7b2967 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.595557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b098a8-4322-425a-93f8-adbabc7b2967 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:33.595557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b098a8-4322-425a-93f8-adbabc7b2967 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:33.596917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b098a8-4322-425a-93f8-adbabc7b2967 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.618426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:33.621445 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 415/812] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 11:59:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:33.622457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b098a8-4322-425a-93f8-adbabc7b2967 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:33.685085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8ae3-c047-47d1-a5ea-1fdd69ae9c65 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:33.721889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26c8c4-9c93-4674-989b-c273e7cab659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:33.723038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26c8c4-9c93-4674-989b-c273e7cab659 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.723038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26c8c4-9c93-4674-989b-c273e7cab659 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.723038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26c8c4-9c93-4674-989b-c273e7cab659 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.723611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26c8c4-9c93-4674-989b-c273e7cab659 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:33.725023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26c8c4-9c93-4674-989b-c273e7cab659 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-1f26c8c4-9c93-4674-989b-c273e7cab659 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:33.734026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:33.735084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:33.735982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 398/813] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Sep 9 11:59:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:33.736836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26c8c4-9c93-4674-989b-c273e7cab659 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:33.761012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b098a8-4322-425a-93f8-adbabc7b2967 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:33.789981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:33.800688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20930c2-5f13-42f5-a0df-1a11e86aee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:33.801306 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20930c2-5f13-42f5-a0df-1a11e86aee89 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.801640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20930c2-5f13-42f5-a0df-1a11e86aee89 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.801919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20930c2-5f13-42f5-a0df-1a11e86aee89 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.802649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20930c2-5f13-42f5-a0df-1a11e86aee89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:33.802960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20930c2-5f13-42f5-a0df-1a11e86aee89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:33.804426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20930c2-5f13-42f5-a0df-1a11e86aee89 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.826018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 416/814] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 11:59:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:33.827060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20930c2-5f13-42f5-a0df-1a11e86aee89 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:33.847998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26c8c4-9c93-4674-989b-c273e7cab659 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:33.864340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:33.881916 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698530e-def2-4560-a6e2-bf588fe9b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:33.882569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698530e-def2-4560-a6e2-bf588fe9b980 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.882855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698530e-def2-4560-a6e2-bf588fe9b980 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.883129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698530e-def2-4560-a6e2-bf588fe9b980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.937255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20930c2-5f13-42f5-a0df-1a11e86aee89 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:33.954201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698530e-def2-4560-a6e2-bf588fe9b980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:33.955823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698530e-def2-4560-a6e2-bf588fe9b980 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.974406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ce6d1-ff66-41d6-a665-a2bf168a21c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:33.975125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ce6d1-ff66-41d6-a665-a2bf168a21c5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:33.975478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ce6d1-ff66-41d6-a665-a2bf168a21c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:33.975844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ce6d1-ff66-41d6-a665-a2bf168a21c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:33.976611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ce6d1-ff66-41d6-a665-a2bf168a21c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:33.978553 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ce6d1-ff66-41d6-a665-a2bf168a21c5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-2b2ce6d1-ff66-41d6-a665-a2bf168a21c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:33.988297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:33.989524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:59:33.990541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:33.995437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 417/815] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:33 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:33.996319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ce6d1-ff66-41d6-a665-a2bf168a21c5 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.057610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:34.068333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 399/816] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:34.082041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698530e-def2-4560-a6e2-bf588fe9b980 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.088167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:34.125221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ce6d1-ff66-41d6-a665-a2bf168a21c5 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.161140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc39c4-9ab9-40de-baab-ee65be731d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.161750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc39c4-9ab9-40de-baab-ee65be731d51 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.162029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc39c4-9ab9-40de-baab-ee65be731d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.162305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc39c4-9ab9-40de-baab-ee65be731d51 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.162933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc39c4-9ab9-40de-baab-ee65be731d51 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:34.163232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc39c4-9ab9-40de-baab-ee65be731d51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.164614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc39c4-9ab9-40de-baab-ee65be731d51 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.169689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 418/817] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 11:59:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:34.174832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698530e-def2-4560-a6e2-bf588fe9b980 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.175084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc39c4-9ab9-40de-baab-ee65be731d51 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.209007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb0a66-8480-4729-8d4d-d462ad4a6ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.209642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb0a66-8480-4729-8d4d-d462ad4a6ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.209918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb0a66-8480-4729-8d4d-d462ad4a6ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.210194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb0a66-8480-4729-8d4d-d462ad4a6ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.221206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb0a66-8480-4729-8d4d-d462ad4a6ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.222637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb0a66-8480-4729-8d4d-d462ad4a6ed8 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-7adb0a66-8480-4729-8d4d-d462ad4a6ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:34.237542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:34.238529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:34.239428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:34.239428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:34.239428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:34.239428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 400/818] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:34.240196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb0a66-8480-4729-8d4d-d462ad4a6ed8 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.282810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc39c4-9ab9-40de-baab-ee65be731d51 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.297433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:34.309250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:34.319856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a244-2f81-49ab-8777-7b951cf31c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.320667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a244-2f81-49ab-8777-7b951cf31c17 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.320943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a244-2f81-49ab-8777-7b951cf31c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.322302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a244-2f81-49ab-8777-7b951cf31c17 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.322668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6a244-2f81-49ab-8777-7b951cf31c17 None admin] RBAC: Adding query filter params (name=network) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:34.322973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6a244-2f81-49ab-8777-7b951cf31c17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.324347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6a244-2f81-49ab-8777-7b951cf31c17 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.328647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 419/819] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:34.332616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a244-2f81-49ab-8777-7b951cf31c17 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.346221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb0a66-8480-4729-8d4d-d462ad4a6ed8 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.388406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78f75-6343-46d5-8409-e99f980e3fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.389381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78f75-6343-46d5-8409-e99f980e3fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.389670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78f75-6343-46d5-8409-e99f980e3fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.389947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78f75-6343-46d5-8409-e99f980e3fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.404420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc78f75-6343-46d5-8409-e99f980e3fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.406166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc78f75-6343-46d5-8409-e99f980e3fc5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-cbc78f75-6343-46d5-8409-e99f980e3fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:34.421495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:34.422663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:34.423879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:34.423879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:34.423879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:34.427383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 401/820] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:34.428268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78f75-6343-46d5-8409-e99f980e3fc5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.456444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a244-2f81-49ab-8777-7b951cf31c17 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.498859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75df61-6114-4a4b-b0ea-3b075b839aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.499485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75df61-6114-4a4b-b0ea-3b075b839aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.499803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75df61-6114-4a4b-b0ea-3b075b839aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.500076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75df61-6114-4a4b-b0ea-3b075b839aa4 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.500711 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75df61-6114-4a4b-b0ea-3b075b839aa4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:34.501323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75df61-6114-4a4b-b0ea-3b075b839aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.502689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75df61-6114-4a4b-b0ea-3b075b839aa4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.512452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 420/821] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 11:59:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:34.512452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75df61-6114-4a4b-b0ea-3b075b839aa4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.541260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78f75-6343-46d5-8409-e99f980e3fc5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.558319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:34.562104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:34.577509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ece383-bf74-4aaa-8614-79bd0cc75b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.578186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ece383-bf74-4aaa-8614-79bd0cc75b2d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.578470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ece383-bf74-4aaa-8614-79bd0cc75b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.578743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ece383-bf74-4aaa-8614-79bd0cc75b2d None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.579438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ece383-bf74-4aaa-8614-79bd0cc75b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:34.579824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ece383-bf74-4aaa-8614-79bd0cc75b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.581184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ece383-bf74-4aaa-8614-79bd0cc75b2d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.593142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 402/822] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:34.594416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ece383-bf74-4aaa-8614-79bd0cc75b2d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.627449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75df61-6114-4a4b-b0ea-3b075b839aa4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.663127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab093d55-4246-4fa3-bbfb-8671d7d1667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.663765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab093d55-4246-4fa3-bbfb-8671d7d1667f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.664050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab093d55-4246-4fa3-bbfb-8671d7d1667f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.664322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab093d55-4246-4fa3-bbfb-8671d7d1667f None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.664947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab093d55-4246-4fa3-bbfb-8671d7d1667f None admin] RBAC: Adding query filter params (type=network) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:34.665886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab093d55-4246-4fa3-bbfb-8671d7d1667f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.667325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab093d55-4246-4fa3-bbfb-8671d7d1667f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.676947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 421/823] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:34.677668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab093d55-4246-4fa3-bbfb-8671d7d1667f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.705629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ece383-bf74-4aaa-8614-79bd0cc75b2d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.740259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcfa31-f9ae-4ca5-aeb4-1c7cce7dd5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.740870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcfa31-f9ae-4ca5-aeb4-1c7cce7dd5fc None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.741153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcfa31-f9ae-4ca5-aeb4-1c7cce7dd5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.741608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcfa31-f9ae-4ca5-aeb4-1c7cce7dd5fc None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.742245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcfa31-f9ae-4ca5-aeb4-1c7cce7dd5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:34.742554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcfa31-f9ae-4ca5-aeb4-1c7cce7dd5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.744549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcfa31-f9ae-4ca5-aeb4-1c7cce7dd5fc None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.757384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 403/824] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:34.758063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcfa31-f9ae-4ca5-aeb4-1c7cce7dd5fc None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.802561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab093d55-4246-4fa3-bbfb-8671d7d1667f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.805035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:34.808978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:34.851944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc36e7-a366-4e28-b86a-89663fef31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.852671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc36e7-a366-4e28-b86a-89663fef31ab None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.853542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc36e7-a366-4e28-b86a-89663fef31ab None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.853799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc36e7-a366-4e28-b86a-89663fef31ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.854485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc36e7-a366-4e28-b86a-89663fef31ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.855884 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc36e7-a366-4e28-b86a-89663fef31ab None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.879208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcfa31-f9ae-4ca5-aeb4-1c7cce7dd5fc None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:34.914086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f57fd-7758-4d5b-a3f2-1bfb1319aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:34.914748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f57fd-7758-4d5b-a3f2-1bfb1319aa17 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:34.915077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f57fd-7758-4d5b-a3f2-1bfb1319aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:34.915918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f57fd-7758-4d5b-a3f2-1bfb1319aa17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:34.922691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f57fd-7758-4d5b-a3f2-1bfb1319aa17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:34.924152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f57fd-7758-4d5b-a3f2-1bfb1319aa17 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-031f57fd-7758-4d5b-a3f2-1bfb1319aa17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:34.935636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:34.936840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 404/825] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:34.937776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f57fd-7758-4d5b-a3f2-1bfb1319aa17 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:34.983711 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 422/826] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 11:59:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:34.983711 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc36e7-a366-4e28-b86a-89663fef31ab None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:35.088795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:35.093062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f57fd-7758-4d5b-a3f2-1bfb1319aa17 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:35.137060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc36e7-a366-4e28-b86a-89663fef31ab None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:35.148575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c07f07-54e6-40a9-9a0c-3aca4f3f11f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:35.149192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07f07-54e6-40a9-9a0c-3aca4f3f11f1 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:35.149465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07f07-54e6-40a9-9a0c-3aca4f3f11f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:35.150329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07f07-54e6-40a9-9a0c-3aca4f3f11f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:35.151004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c07f07-54e6-40a9-9a0c-3aca4f3f11f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:35.152483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c07f07-54e6-40a9-9a0c-3aca4f3f11f1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:35.179367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db5724-62df-40c7-8ae4-a65a2f7d28f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:35.184272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db5724-62df-40c7-8ae4-a65a2f7d28f2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:35.184272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db5724-62df-40c7-8ae4-a65a2f7d28f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:35.184272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db5724-62df-40c7-8ae4-a65a2f7d28f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:35.188162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db5724-62df-40c7-8ae4-a65a2f7d28f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:35.189607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db5724-62df-40c7-8ae4-a65a2f7d28f2 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-87db5724-62df-40c7-8ae4-a65a2f7d28f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:35.201976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:35.208524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 423/827] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:35.209405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db5724-62df-40c7-8ae4-a65a2f7d28f2 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:35.224320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:35.232199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 405/828] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 11:59:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:35.233783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651a32-6b0c-4e33-bfbf-327a9fa91d2a None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:35.236213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651a32-6b0c-4e33-bfbf-327a9fa91d2a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:35.236213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651a32-6b0c-4e33-bfbf-327a9fa91d2a None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:35.236213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 406/829] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:35.237097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651a32-6b0c-4e33-bfbf-327a9fa91d2a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:35.343120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db5724-62df-40c7-8ae4-a65a2f7d28f2 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:35.395785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651a32-6b0c-4e33-bfbf-327a9fa91d2a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:35.398211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26bc7-586c-4108-a4c5-8b3fd360ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:35.399222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26bc7-586c-4108-a4c5-8b3fd360ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:35.400324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26bc7-586c-4108-a4c5-8b3fd360ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:35.400822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26bc7-586c-4108-a4c5-8b3fd360ddd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:35.401761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae26bc7-586c-4108-a4c5-8b3fd360ddd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:35.402330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae26bc7-586c-4108-a4c5-8b3fd360ddd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:35.404102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae26bc7-586c-4108-a4c5-8b3fd360ddd9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:35.418072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 424/830] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:35.419880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b17dc9-e891-4315-adcf-ee42f8db7070 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:35.420468 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b17dc9-e891-4315-adcf-ee42f8db7070 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:35.420957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b17dc9-e891-4315-adcf-ee42f8db7070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:35.441579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-23b17dc9-e891-4315-adcf-ee42f8db7070 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:35.442504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2464e72-1f46-4ac1-a49b-73c6d8bfae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:35.443059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2464e72-1f46-4ac1-a49b-73c6d8bfae27 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:35.443226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-23b17dc9-e891-4315-adcf-ee42f8db7070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:35.443397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2464e72-1f46-4ac1-a49b-73c6d8bfae27 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:35.443687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2464e72-1f46-4ac1-a49b-73c6d8bfae27 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:35.444371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2464e72-1f46-4ac1-a49b-73c6d8bfae27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:35.444739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2464e72-1f46-4ac1-a49b-73c6d8bfae27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:35.446439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2464e72-1f46-4ac1-a49b-73c6d8bfae27 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:35.464260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 407/831] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:35.468045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2464e72-1f46-4ac1-a49b-73c6d8bfae27 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:35.488925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:35.562682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 425/832] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:35.569568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b17dc9-e891-4315-adcf-ee42f8db7070 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:35.581900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:35.605646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2464e72-1f46-4ac1-a49b-73c6d8bfae27 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:35.652468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea59bd9-9d7c-42be-8b54-5b04f511003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:35.653371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59bd9-9d7c-42be-8b54-5b04f511003a None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:35.653631 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59bd9-9d7c-42be-8b54-5b04f511003a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:35.653905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59bd9-9d7c-42be-8b54-5b04f511003a None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/18bd4f37058e4019a1e5f13dfdcdc4ac/roles/73f84507c19147c0b7e3cdf8ac72e212` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:35.674580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea59bd9-9d7c-42be-8b54-5b04f511003a None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=18bd4f37058e4019a1e5f13dfdcdc4ac, role_id=73f84507c19147c0b7e3cdf8ac72e212)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:35.676587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea59bd9-9d7c-42be-8b54-5b04f511003a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:35.702206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b17dc9-e891-4315-adcf-ee42f8db7070 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:35.738913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842f0d1-0a23-4608-a82a-6b6519219005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:35.739848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842f0d1-0a23-4608-a82a-6b6519219005 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:35.740305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842f0d1-0a23-4608-a82a-6b6519219005 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:35.740907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842f0d1-0a23-4608-a82a-6b6519219005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:35.741805 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842f0d1-0a23-4608-a82a-6b6519219005 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=4971acb91bbf498887606c5ba5d00176) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:35.742290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842f0d1-0a23-4608-a82a-6b6519219005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:35.744026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842f0d1-0a23-4608-a82a-6b6519219005 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:35.751431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 426/833] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:35 2022] GET /identity/v3/role_assignments?user.id=4971acb91bbf498887606c5ba5d00176&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=06592016669243d99b430c46dd1c1d46 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:35.784596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 408/834] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:59:35 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/18bd4f37058e4019a1e5f13dfdcdc4ac/roles/73f84507c19147c0b7e3cdf8ac72e212 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:59:35.851134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842f0d1-0a23-4608-a82a-6b6519219005 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:35.936568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:35.975230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842f0d1-0a23-4608-a82a-6b6519219005 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:36.017563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ff185-64a8-46b9-800d-e4dbaf6b5ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:36.018166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ff185-64a8-46b9-800d-e4dbaf6b5ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:36.018449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ff185-64a8-46b9-800d-e4dbaf6b5ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:36.018817 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ff185-64a8-46b9-800d-e4dbaf6b5ef2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:36.031178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ff185-64a8-46b9-800d-e4dbaf6b5ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-a48ff185-64a8-46b9-800d-e4dbaf6b5ef2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:36.037755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:36.038938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:36.039946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 427/835] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:36.046386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea59bd9-9d7c-42be-8b54-5b04f511003a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:36.126462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:36.170270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea59bd9-9d7c-42be-8b54-5b04f511003a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:36.210740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46340b8b-a72e-494b-b64c-d9341c8a0a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:36.211285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340b8b-a72e-494b-b64c-d9341c8a0a0d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:36.211561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340b8b-a72e-494b-b64c-d9341c8a0a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:36.211878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340b8b-a72e-494b-b64c-d9341c8a0a0d None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:36.213114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340b8b-a72e-494b-b64c-d9341c8a0a0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:36.213416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340b8b-a72e-494b-b64c-d9341c8a0a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:36.214778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340b8b-a72e-494b-b64c-d9341c8a0a0d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:36.227743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 409/836] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:36.229700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ff185-64a8-46b9-800d-e4dbaf6b5ef2 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:36.335371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ff185-64a8-46b9-800d-e4dbaf6b5ef2 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:36.364060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:36.370429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de9c63-5e88-4a11-a5dc-653ec9cb01d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:36.371063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de9c63-5e88-4a11-a5dc-653ec9cb01d7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:36.371341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de9c63-5e88-4a11-a5dc-653ec9cb01d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:36.381558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de9c63-5e88-4a11-a5dc-653ec9cb01d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:36.383964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de9c63-5e88-4a11-a5dc-653ec9cb01d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:36.385968 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de9c63-5e88-4a11-a5dc-653ec9cb01d7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-36de9c63-5e88-4a11-a5dc-653ec9cb01d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:36.400564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:36.401577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:36.402454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:36.402454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:36.402454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:36.406466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 428/837] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:36.408055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46340b8b-a72e-494b-b64c-d9341c8a0a0d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:36.513727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46340b8b-a72e-494b-b64c-d9341c8a0a0d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:36.537302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:36.547992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61696c-4624-41e1-a456-55965516d930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:36.548686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61696c-4624-41e1-a456-55965516d930 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:36.549034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61696c-4624-41e1-a456-55965516d930 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:36.549373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61696c-4624-41e1-a456-55965516d930 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:36.550087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61696c-4624-41e1-a456-55965516d930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:36.550462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61696c-4624-41e1-a456-55965516d930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:36.552036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61696c-4624-41e1-a456-55965516d930 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:36.569396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 410/838] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:36.570810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de9c63-5e88-4a11-a5dc-653ec9cb01d7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:36.676570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de9c63-5e88-4a11-a5dc-653ec9cb01d7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:36.711871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c1c1c-7d14-4b64-a5d7-5321a454045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:36.712854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c1c1c-7d14-4b64-a5d7-5321a454045a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:36.713293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c1c1c-7d14-4b64-a5d7-5321a454045a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:36.713714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c1c1c-7d14-4b64-a5d7-5321a454045a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:36.722071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c1c1c-7d14-4b64-a5d7-5321a454045a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:36.723734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c1c1c-7d14-4b64-a5d7-5321a454045a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-527c1c1c-7d14-4b64-a5d7-5321a454045a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:36.736253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:36.737423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:59:36.738603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:36.740771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 429/839] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 11:59:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:36.750340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61696c-4624-41e1-a456-55965516d930 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:36.858733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61696c-4624-41e1-a456-55965516d930 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:36.895075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3105b4-32de-48c7-97f6-3ade9a9076d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:36.895790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3105b4-32de-48c7-97f6-3ade9a9076d1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:36.896069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3105b4-32de-48c7-97f6-3ade9a9076d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:36.896340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3105b4-32de-48c7-97f6-3ade9a9076d1 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:36.897078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3105b4-32de-48c7-97f6-3ade9a9076d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:36.897380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3105b4-32de-48c7-97f6-3ade9a9076d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:36.898836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3105b4-32de-48c7-97f6-3ade9a9076d1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:36.923562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 411/840] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 11:59:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:36.925000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c1c1c-7d14-4b64-a5d7-5321a454045a None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:36.969415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:37.028024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c1c1c-7d14-4b64-a5d7-5321a454045a None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:37.063732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf055f8-d444-4083-998b-bdf186e8bf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:37.064836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf055f8-d444-4083-998b-bdf186e8bf82 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:37.065327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf055f8-d444-4083-998b-bdf186e8bf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:37.065856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf055f8-d444-4083-998b-bdf186e8bf82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:37.137028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf055f8-d444-4083-998b-bdf186e8bf82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:37.138624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf055f8-d444-4083-998b-bdf186e8bf82 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:37.188074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:37.245859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 430/841] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:37.251701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3105b4-32de-48c7-97f6-3ade9a9076d1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:37.303939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:37.349174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92cbab-bd50-483f-a4b2-c0434eff66a7 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:37.349505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92cbab-bd50-483f-a4b2-c0434eff66a7 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:37.349727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92cbab-bd50-483f-a4b2-c0434eff66a7 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:37.351318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 431/842] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:37.356314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a457f68-7de8-4167-95ba-e59dd41d60b5 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:37.356600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a457f68-7de8-4167-95ba-e59dd41d60b5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:37.356879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a457f68-7de8-4167-95ba-e59dd41d60b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:37.366240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3105b4-32de-48c7-97f6-3ade9a9076d1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:37.376370 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2a457f68-7de8-4167-95ba-e59dd41d60b5 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:37.377616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2a457f68-7de8-4167-95ba-e59dd41d60b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:37.410903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4e320-f481-4074-a772-3528f97d8a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:37.411663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4e320-f481-4074-a772-3528f97d8a22 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:37.411956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4e320-f481-4074-a772-3528f97d8a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:37.412237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4e320-f481-4074-a772-3528f97d8a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:37.425697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4e320-f481-4074-a772-3528f97d8a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:37.427743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4e320-f481-4074-a772-3528f97d8a22 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-9ae4e320-f481-4074-a772-3528f97d8a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:37.447519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:37.448548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:37.449463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:37.449463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:37.449463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:37.449463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 412/843] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:37.456029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 432/844] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:37.456753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4e320-f481-4074-a772-3528f97d8a22 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:37.557187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:37.569197 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4e320-f481-4074-a772-3528f97d8a22 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:37.603956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfdeee-7b6f-4b68-95a4-d8d9fe1eda99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:37.604564 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfdeee-7b6f-4b68-95a4-d8d9fe1eda99 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:37.604848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfdeee-7b6f-4b68-95a4-d8d9fe1eda99 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:37.605125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfdeee-7b6f-4b68-95a4-d8d9fe1eda99 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:37.605767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfdeee-7b6f-4b68-95a4-d8d9fe1eda99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:37.606074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfdeee-7b6f-4b68-95a4-d8d9fe1eda99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:37.607435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfdeee-7b6f-4b68-95a4-d8d9fe1eda99 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:37.623742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 413/845] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:37.625557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a457f68-7de8-4167-95ba-e59dd41d60b5 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:37.700903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:37.725509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfdeee-7b6f-4b68-95a4-d8d9fe1eda99 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:37.735412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a457f68-7de8-4167-95ba-e59dd41d60b5 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:37.773579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae0ba-19c6-4485-aea3-749b399e534d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:37.774615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae0ba-19c6-4485-aea3-749b399e534d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:37.775697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae0ba-19c6-4485-aea3-749b399e534d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:37.776178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae0ba-19c6-4485-aea3-749b399e534d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:37.783887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bae0ba-19c6-4485-aea3-749b399e534d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:37.785746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bae0ba-19c6-4485-aea3-749b399e534d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-58bae0ba-19c6-4485-aea3-749b399e534d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:37.800147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:37.801110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:37.802024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:37.802024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:37.802024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:37.802024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:37.802024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:37.802024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:37.802024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:37.802024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:37.810098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 433/846] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:37.811654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae0ba-19c6-4485-aea3-749b399e534d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:37.836407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfdeee-7b6f-4b68-95a4-d8d9fe1eda99 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:37.883154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b5a4d-88d1-4545-98b5-2e002d3ecd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:37.884471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b5a4d-88d1-4545-98b5-2e002d3ecd97 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:37.884910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b5a4d-88d1-4545-98b5-2e002d3ecd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:37.885623 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b5a4d-88d1-4545-98b5-2e002d3ecd97 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:37.886793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b5a4d-88d1-4545-98b5-2e002d3ecd97 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:37.888632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b5a4d-88d1-4545-98b5-2e002d3ecd97 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-bd5b5a4d-88d1-4545-98b5-2e002d3ecd97 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:37.901762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:37.903023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:59:37.904116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:37.907355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 414/847] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:59:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:37.912997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b5a4d-88d1-4545-98b5-2e002d3ecd97 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:37.936539 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:37.945956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae0ba-19c6-4485-aea3-749b399e534d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:37.985204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:37.985204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b12c34-91f5-45c8-9ddb-6c30b3c2fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:37.985528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b12c34-91f5-45c8-9ddb-6c30b3c2fe77 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:37.985641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b12c34-91f5-45c8-9ddb-6c30b3c2fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:37.985971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b12c34-91f5-45c8-9ddb-6c30b3c2fe77 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:37.986677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b12c34-91f5-45c8-9ddb-6c30b3c2fe77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:37.986987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b12c34-91f5-45c8-9ddb-6c30b3c2fe77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:37.988542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b12c34-91f5-45c8-9ddb-6c30b3c2fe77 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:38.004016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 434/848] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:38.009950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b12c34-91f5-45c8-9ddb-6c30b3c2fe77 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:38.048248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b5a4d-88d1-4545-98b5-2e002d3ecd97 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:38.084749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc2f7f-6baa-4c68-9254-02faab1a1e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:38.085518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc2f7f-6baa-4c68-9254-02faab1a1e08 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.085776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc2f7f-6baa-4c68-9254-02faab1a1e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.086056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc2f7f-6baa-4c68-9254-02faab1a1e08 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.086693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc2f7f-6baa-4c68-9254-02faab1a1e08 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:38.086999 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc2f7f-6baa-4c68-9254-02faab1a1e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:38.088936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc2f7f-6baa-4c68-9254-02faab1a1e08 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:38.098513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 415/849] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:59:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:38.099401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc2f7f-6baa-4c68-9254-02faab1a1e08 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:38.146554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b12c34-91f5-45c8-9ddb-6c30b3c2fe77 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:38.183589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7cf38-ca8a-44df-b948-2f017194ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:38.184273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7cf38-ca8a-44df-b948-2f017194ac7a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.184559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7cf38-ca8a-44df-b948-2f017194ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.184834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7cf38-ca8a-44df-b948-2f017194ac7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.185565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7cf38-ca8a-44df-b948-2f017194ac7a None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=063f7bf74f444c14b9bf6c0ca936dd12) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:38.185874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7cf38-ca8a-44df-b948-2f017194ac7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:38.187289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7cf38-ca8a-44df-b948-2f017194ac7a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:38.198796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 435/850] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:38 2022] GET /identity/v3/role_assignments?user.id=063f7bf74f444c14b9bf6c0ca936dd12&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=06592016669243d99b430c46dd1c1d46 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:38.198796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264f4b-f53b-417e-8257-676837676974 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.198796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264f4b-f53b-417e-8257-676837676974 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.198796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264f4b-f53b-417e-8257-676837676974 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.198796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 436/851] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:38.203559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:38.204792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf71ec-cd40-46a1-86c0-aeef9085f6e1 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.205082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf71ec-cd40-46a1-86c0-aeef9085f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.205357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf71ec-cd40-46a1-86c0-aeef9085f6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.222636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc2f7f-6baa-4c68-9254-02faab1a1e08 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:38.226667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-79bf71ec-cd40-46a1-86c0-aeef9085f6e1 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:38.228084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-79bf71ec-cd40-46a1-86c0-aeef9085f6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:38.268298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978735a4-5516-4f7b-8bf3-0a888d3f7feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:38.269135 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978735a4-5516-4f7b-8bf3-0a888d3f7feb None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.269480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978735a4-5516-4f7b-8bf3-0a888d3f7feb None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.269828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978735a4-5516-4f7b-8bf3-0a888d3f7feb None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.270548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978735a4-5516-4f7b-8bf3-0a888d3f7feb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:38.270922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978735a4-5516-4f7b-8bf3-0a888d3f7feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:38.272645 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978735a4-5516-4f7b-8bf3-0a888d3f7feb None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:38.281758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 416/852] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:59:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:38.300224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:38.320603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 437/853] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:59:38.347149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad879a-6955-4bea-b364-452b080022c0 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.347438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad879a-6955-4bea-b364-452b080022c0 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.347751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad879a-6955-4bea-b364-452b080022c0 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.349535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 417/854] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:38.355606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42ca2-1024-4f89-a0b3-0e7d33fa2772 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.355920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42ca2-1024-4f89-a0b3-0e7d33fa2772 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.356202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42ca2-1024-4f89-a0b3-0e7d33fa2772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.377718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6fd42ca2-1024-4f89-a0b3-0e7d33fa2772 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:38.378959 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6fd42ca2-1024-4f89-a0b3-0e7d33fa2772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:38.461052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 438/855] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:38.611547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad879a-6955-4bea-b364-452b080022c0 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:38.723806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad879a-6955-4bea-b364-452b080022c0 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:38.733121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd42ca2-1024-4f89-a0b3-0e7d33fa2772 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:38.766266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc90079-8fe0-4b96-aec8-e4c569f752c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:38.767162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc90079-8fe0-4b96-aec8-e4c569f752c4 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.767443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc90079-8fe0-4b96-aec8-e4c569f752c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.768174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc90079-8fe0-4b96-aec8-e4c569f752c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.782308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc90079-8fe0-4b96-aec8-e4c569f752c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-fcc90079-8fe0-4b96-aec8-e4c569f752c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:38.789156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:38.790099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:38.791165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 418/856] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 11:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:38.796729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc90079-8fe0-4b96-aec8-e4c569f752c4 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:38.808651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:38.856341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd42ca2-1024-4f89-a0b3-0e7d33fa2772 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:38.876793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:38.898196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cb5f0-99a1-4bf9-aebb-055e31e8fe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:38.899243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cb5f0-99a1-4bf9-aebb-055e31e8fe20 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.899823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cb5f0-99a1-4bf9-aebb-055e31e8fe20 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.900324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cb5f0-99a1-4bf9-aebb-055e31e8fe20 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.901194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cb5f0-99a1-4bf9-aebb-055e31e8fe20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:38.902829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cb5f0-99a1-4bf9-aebb-055e31e8fe20 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-9c4cb5f0-99a1-4bf9-aebb-055e31e8fe20 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:38.913559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:38.914510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:59:38.915954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:38.918691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 439/857] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Sep 9 11:59:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:38.926629 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cb5f0-99a1-4bf9-aebb-055e31e8fe20 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:38.929180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc90079-8fe0-4b96-aec8-e4c569f752c4 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:38.978862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96eddbc-7927-46bc-81de-4444a838952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:38.979479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eddbc-7927-46bc-81de-4444a838952c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:38.979784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eddbc-7927-46bc-81de-4444a838952c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:38.980056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eddbc-7927-46bc-81de-4444a838952c None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:38.980846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96eddbc-7927-46bc-81de-4444a838952c None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:38.981018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96eddbc-7927-46bc-81de-4444a838952c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:38.982509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96eddbc-7927-46bc-81de-4444a838952c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:38.996798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 419/858] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 11:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:38.997866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96eddbc-7927-46bc-81de-4444a838952c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:39.046752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cb5f0-99a1-4bf9-aebb-055e31e8fe20 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:39.088577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326bf09-a265-4a24-9432-6ae321ca3c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:39.089191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326bf09-a265-4a24-9432-6ae321ca3c77 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:39.089472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326bf09-a265-4a24-9432-6ae321ca3c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:39.089751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326bf09-a265-4a24-9432-6ae321ca3c77 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:39.090389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326bf09-a265-4a24-9432-6ae321ca3c77 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:39.090693 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326bf09-a265-4a24-9432-6ae321ca3c77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:39.092092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326bf09-a265-4a24-9432-6ae321ca3c77 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:39.097590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:39.101730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 440/859] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:39.102613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326bf09-a265-4a24-9432-6ae321ca3c77 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:39.154905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96eddbc-7927-46bc-81de-4444a838952c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:39.166949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:39.203737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4092a-5f89-4a7b-a121-6dfdec6ef7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:39.205085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4092a-5f89-4a7b-a121-6dfdec6ef7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:39.205479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4092a-5f89-4a7b-a121-6dfdec6ef7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:39.205866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4092a-5f89-4a7b-a121-6dfdec6ef7b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:39.219335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4092a-5f89-4a7b-a121-6dfdec6ef7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:39.220996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4092a-5f89-4a7b-a121-6dfdec6ef7b0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:39.235996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326bf09-a265-4a24-9432-6ae321ca3c77 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-42b4092a-5f89-4a7b-a121-6dfdec6ef7b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:39.238099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:39.239220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:39.240163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:39.240163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:39.240163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:39.245690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 420/860] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:39.246644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4092a-5f89-4a7b-a121-6dfdec6ef7b0 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:39.283478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6db07-8741-4eeb-8625-48c51cd53da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:39.285517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6db07-8741-4eeb-8625-48c51cd53da7 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:39.286016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6db07-8741-4eeb-8625-48c51cd53da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:39.286470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6db07-8741-4eeb-8625-48c51cd53da7 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:39.287269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6db07-8741-4eeb-8625-48c51cd53da7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:39.287779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6db07-8741-4eeb-8625-48c51cd53da7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:39.289308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6db07-8741-4eeb-8625-48c51cd53da7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:39.296715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 441/861] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:39.370853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4092a-5f89-4a7b-a121-6dfdec6ef7b0 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:39.394398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:39.411322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332753-4b86-4020-aeeb-315d54f4a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:39.412312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332753-4b86-4020-aeeb-315d54f4a644 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:39.412776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332753-4b86-4020-aeeb-315d54f4a644 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:39.413328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332753-4b86-4020-aeeb-315d54f4a644 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:39.414160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d332753-4b86-4020-aeeb-315d54f4a644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:39.414644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d332753-4b86-4020-aeeb-315d54f4a644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:39.416833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d332753-4b86-4020-aeeb-315d54f4a644 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:39.431346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 421/862] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:39.436917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6db07-8741-4eeb-8625-48c51cd53da7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:39.548497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6db07-8741-4eeb-8625-48c51cd53da7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:39.567654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:39.596036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf56a7-8493-4a7f-b109-2cd9fbc85e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:39.596974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf56a7-8493-4a7f-b109-2cd9fbc85e68 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:39.597460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf56a7-8493-4a7f-b109-2cd9fbc85e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:39.597912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf56a7-8493-4a7f-b109-2cd9fbc85e68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:39.607008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf56a7-8493-4a7f-b109-2cd9fbc85e68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:39.608723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf56a7-8493-4a7f-b109-2cd9fbc85e68 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-8caf56a7-8493-4a7f-b109-2cd9fbc85e68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:39.620682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:39.621670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:39.622616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:39.624903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 442/863] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 11:59:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:39.633534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332753-4b86-4020-aeeb-315d54f4a644 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:39.741448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332753-4b86-4020-aeeb-315d54f4a644 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:39.781528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae815f8-e577-41e2-958b-b511249b5c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:39.782147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae815f8-e577-41e2-958b-b511249b5c95 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:39.782426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae815f8-e577-41e2-958b-b511249b5c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:39.782700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae815f8-e577-41e2-958b-b511249b5c95 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:39.783423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae815f8-e577-41e2-958b-b511249b5c95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:39.783754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae815f8-e577-41e2-958b-b511249b5c95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:39.785188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae815f8-e577-41e2-958b-b511249b5c95 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:39.803660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 422/864] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 11:59:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:39.809506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf56a7-8493-4a7f-b109-2cd9fbc85e68 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:39.916713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf56a7-8493-4a7f-b109-2cd9fbc85e68 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:39.951433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a252710-b1db-4776-830f-99db0429e824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:39.952065 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a252710-b1db-4776-830f-99db0429e824 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:39.952344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a252710-b1db-4776-830f-99db0429e824 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:39.952617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a252710-b1db-4776-830f-99db0429e824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:39.987940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:40.023802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a252710-b1db-4776-830f-99db0429e824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:40.025743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a252710-b1db-4776-830f-99db0429e824 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:40.126815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 443/865] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:39 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:40.132380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae815f8-e577-41e2-958b-b511249b5c95 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:40.175035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:40.238627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae815f8-e577-41e2-958b-b511249b5c95 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:40.275638 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aebb4-f902-4d34-82d4-2c6bd7fd0fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:40.276207 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aebb4-f902-4d34-82d4-2c6bd7fd0fca None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:40.276493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aebb4-f902-4d34-82d4-2c6bd7fd0fca None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:40.276769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aebb4-f902-4d34-82d4-2c6bd7fd0fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:40.287320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37aebb4-f902-4d34-82d4-2c6bd7fd0fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:40.288805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37aebb4-f902-4d34-82d4-2c6bd7fd0fca None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-b37aebb4-f902-4d34-82d4-2c6bd7fd0fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:40.304124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:40.305140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:40.306585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:40.306585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:40.306585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:40.306585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 423/866] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:40.312083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a252710-b1db-4776-830f-99db0429e824 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:40.385038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:40.429497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a252710-b1db-4776-830f-99db0429e824 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:40.467926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac6a05-4f75-42b1-b844-74d3fd34f1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:40.468549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac6a05-4f75-42b1-b844-74d3fd34f1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:40.468835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac6a05-4f75-42b1-b844-74d3fd34f1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:40.469115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac6a05-4f75-42b1-b844-74d3fd34f1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:40.469762 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac6a05-4f75-42b1-b844-74d3fd34f1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:40.470069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac6a05-4f75-42b1-b844-74d3fd34f1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:40.471427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac6a05-4f75-42b1-b844-74d3fd34f1c3 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:40.484642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 444/867] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:40.490350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aebb4-f902-4d34-82d4-2c6bd7fd0fca None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:40.530031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5139c9-65e4-4ffa-9278-b0585df7f028 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:40.530326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5139c9-65e4-4ffa-9278-b0585df7f028 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:40.530534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5139c9-65e4-4ffa-9278-b0585df7f028 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:40.532307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 445/868] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:40.538953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f173c0b-5827-4cfd-8bc8-956dafa8710c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:40.539818 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f173c0b-5827-4cfd-8bc8-956dafa8710c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:40.540209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f173c0b-5827-4cfd-8bc8-956dafa8710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:40.563479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9f173c0b-5827-4cfd-8bc8-956dafa8710c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:40.565578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9f173c0b-5827-4cfd-8bc8-956dafa8710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:40.599572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:40.616183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aebb4-f902-4d34-82d4-2c6bd7fd0fca None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:40.647833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 446/869] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:59:40.649097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadf8a8-edf8-4beb-ada0-b42447d81f5e None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:40.649516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadf8a8-edf8-4beb-ada0-b42447d81f5e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:40.649809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadf8a8-edf8-4beb-ada0-b42447d81f5e None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:40.651654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 447/870] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:40.657486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8795fb-e67d-404c-9926-d8203b1090e2 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:40.657772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8795fb-e67d-404c-9926-d8203b1090e2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:40.658046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8795fb-e67d-404c-9926-d8203b1090e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:40.669399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859973a-ada5-49db-9c80-ab278b16c293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:40.670713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859973a-ada5-49db-9c80-ab278b16c293 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:40.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859973a-ada5-49db-9c80-ab278b16c293 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:40.671789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859973a-ada5-49db-9c80-ab278b16c293 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:40.680341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859973a-ada5-49db-9c80-ab278b16c293 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:40.680919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-7c8795fb-e67d-404c-9926-d8203b1090e2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:40.682719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7c8795fb-e67d-404c-9926-d8203b1090e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:40.683100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859973a-ada5-49db-9c80-ab278b16c293 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-c859973a-ada5-49db-9c80-ab278b16c293 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:40.698061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:40.699050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:40.699989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:40.699989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:40.699989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:40.699989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:40.699989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:40.699989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:40.699989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:40.699989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:40.707152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 424/871] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:40.708732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859973a-ada5-49db-9c80-ab278b16c293 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:40.744784 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:40.767652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 448/872] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:40.825392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859973a-ada5-49db-9c80-ab278b16c293 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:40.861440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fc09a-c2d4-4070-a0ac-cc20bd1aea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:40.862045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fc09a-c2d4-4070-a0ac-cc20bd1aea28 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:40.862324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fc09a-c2d4-4070-a0ac-cc20bd1aea28 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:40.862597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fc09a-c2d4-4070-a0ac-cc20bd1aea28 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:40.863281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fc09a-c2d4-4070-a0ac-cc20bd1aea28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:40.863586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fc09a-c2d4-4070-a0ac-cc20bd1aea28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:40.865604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fc09a-c2d4-4070-a0ac-cc20bd1aea28 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:40.877889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 425/873] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:40.884791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8795fb-e67d-404c-9926-d8203b1090e2 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:40.913545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fc09a-c2d4-4070-a0ac-cc20bd1aea28 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:40.928263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:40.993906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8795fb-e67d-404c-9926-d8203b1090e2 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:41.047019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fc09a-c2d4-4070-a0ac-cc20bd1aea28 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:41.052334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9c41-006b-4141-b874-0b0cbfd0849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:41.052957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9c41-006b-4141-b874-0b0cbfd0849d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:41.053241 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9c41-006b-4141-b874-0b0cbfd0849d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:41.053519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9c41-006b-4141-b874-0b0cbfd0849d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:41.054253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9c41-006b-4141-b874-0b0cbfd0849d None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=18bd4f37058e4019a1e5f13dfdcdc4ac) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:41.054571 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9c41-006b-4141-b874-0b0cbfd0849d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:41.056179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9c41-006b-4141-b874-0b0cbfd0849d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:41.067803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 449/874] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:40 2022] GET /identity/v3/role_assignments?user.id=18bd4f37058e4019a1e5f13dfdcdc4ac&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:41.069374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9c41-006b-4141-b874-0b0cbfd0849d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:41.095160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66231f8b-5e15-49a4-96cd-0a3e1d1b99dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:41.095761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66231f8b-5e15-49a4-96cd-0a3e1d1b99dd None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:41.096047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66231f8b-5e15-49a4-96cd-0a3e1d1b99dd None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:41.096327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66231f8b-5e15-49a4-96cd-0a3e1d1b99dd None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:41.097016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66231f8b-5e15-49a4-96cd-0a3e1d1b99dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:41.098463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66231f8b-5e15-49a4-96cd-0a3e1d1b99dd None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:41.151140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:41.186694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 426/875] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 11:59:40 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:41.210564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9c41-006b-4141-b874-0b0cbfd0849d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:41.264366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6b50-0bb1-4165-b42c-2786d7fb634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:41.265023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6b50-0bb1-4165-b42c-2786d7fb634c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:41.265307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6b50-0bb1-4165-b42c-2786d7fb634c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:41.265583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6b50-0bb1-4165-b42c-2786d7fb634c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:41.266201 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6b50-0bb1-4165-b42c-2786d7fb634c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:41.267675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6b50-0bb1-4165-b42c-2786d7fb634c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-b60f6b50-0bb1-4165-b42c-2786d7fb634c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:41.278291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:41.279396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:41.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 450/876] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:41.285883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66231f8b-5e15-49a4-96cd-0a3e1d1b99dd None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:41.367652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:41.402567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66231f8b-5e15-49a4-96cd-0a3e1d1b99dd None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:41.445869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e5a60-40c7-49d3-ba66-348a9fb1e4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:41.446483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e5a60-40c7-49d3-ba66-348a9fb1e4ee None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:41.447320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e5a60-40c7-49d3-ba66-348a9fb1e4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:41.447608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e5a60-40c7-49d3-ba66-348a9fb1e4ee None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:41.449246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e5a60-40c7-49d3-ba66-348a9fb1e4ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:41.450203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e5a60-40c7-49d3-ba66-348a9fb1e4ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:41.451844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e5a60-40c7-49d3-ba66-348a9fb1e4ee None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:41.460556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 427/877] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:41.466544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6b50-0bb1-4165-b42c-2786d7fb634c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:41.579653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6b50-0bb1-4165-b42c-2786d7fb634c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:41.593298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:41.614612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624be58-7b82-406f-b877-bf14bd7303e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:41.615234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624be58-7b82-406f-b877-bf14bd7303e9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:41.615521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624be58-7b82-406f-b877-bf14bd7303e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:41.615830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624be58-7b82-406f-b877-bf14bd7303e9 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:41.616475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624be58-7b82-406f-b877-bf14bd7303e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:41.616789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624be58-7b82-406f-b877-bf14bd7303e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:41.618219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624be58-7b82-406f-b877-bf14bd7303e9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:41.624017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 451/878] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:41.657480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e769df-872f-4509-bf81-7fd1c0ac3966 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:41.657885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e769df-872f-4509-bf81-7fd1c0ac3966 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:41.658223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e769df-872f-4509-bf81-7fd1c0ac3966 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:41.659989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 428/879] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:41.665910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533108db-8e7f-4739-a9df-9b43e990c61d None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:41.666285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533108db-8e7f-4739-a9df-9b43e990c61d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:41.666565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533108db-8e7f-4739-a9df-9b43e990c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:41.686318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-533108db-8e7f-4739-a9df-9b43e990c61d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:41.687541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-533108db-8e7f-4739-a9df-9b43e990c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:41.774604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 452/880] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:42.047926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e769df-872f-4509-bf81-7fd1c0ac3966 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:42.189252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e769df-872f-4509-bf81-7fd1c0ac3966 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:42.224212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0c24a-4acb-4ae6-8f0b-4df1db7c18ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:42.224821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0c24a-4acb-4ae6-8f0b-4df1db7c18ef None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:42.225101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0c24a-4acb-4ae6-8f0b-4df1db7c18ef None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:42.225378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0c24a-4acb-4ae6-8f0b-4df1db7c18ef None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:42.226092 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0c24a-4acb-4ae6-8f0b-4df1db7c18ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:42.227446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0c24a-4acb-4ae6-8f0b-4df1db7c18ef None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:42.231337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:42.326967 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 429/881] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 11:59:42 2022] POST /identity/v3/services => generated 269 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:43.465980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d983-f107-4d7b-b626-79482448f511 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:43.466527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d983-f107-4d7b-b626-79482448f511 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:43.466527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d983-f107-4d7b-b626-79482448f511 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:43.468039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 453/882] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:43.473430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a72a0-cb57-4137-a38e-e73c52280116 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:43.473874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a72a0-cb57-4137-a38e-e73c52280116 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:43.474023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a72a0-cb57-4137-a38e-e73c52280116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:43.492424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-7b5a72a0-cb57-4137-a38e-e73c52280116 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:43.493613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7b5a72a0-cb57-4137-a38e-e73c52280116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:43.566401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94869d7-1056-4944-b37f-0d5b19af3d40 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:43.566742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94869d7-1056-4944-b37f-0d5b19af3d40 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:43.567232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94869d7-1056-4944-b37f-0d5b19af3d40 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:43.569380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 454/883] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:43.575054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797757ee-a20a-4fac-a3e9-81d70f817807 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:43.575222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 430/884] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:43.575332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797757ee-a20a-4fac-a3e9-81d70f817807 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:43.575604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797757ee-a20a-4fac-a3e9-81d70f817807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:43.595791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-797757ee-a20a-4fac-a3e9-81d70f817807 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:43.596973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-797757ee-a20a-4fac-a3e9-81d70f817807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:43.669807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 455/885] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:43.852516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a72a0-cb57-4137-a38e-e73c52280116 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:43.939778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd476021-e1c4-4527-a8d7-e7df410139ec None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:43.947202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd476021-e1c4-4527-a8d7-e7df410139ec None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:43.947202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd476021-e1c4-4527-a8d7-e7df410139ec None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:43.947202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 456/886] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:59:43.947202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd476021-e1c4-4527-a8d7-e7df410139ec None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:43.968206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a72a0-cb57-4137-a38e-e73c52280116 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:43.987695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:43.990180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:44.005424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426cd5-715b-45a2-a194-a03ce80438e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.006054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426cd5-715b-45a2-a194-a03ce80438e2 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.006335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426cd5-715b-45a2-a194-a03ce80438e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.006607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426cd5-715b-45a2-a194-a03ce80438e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.017000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6426cd5-715b-45a2-a194-a03ce80438e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-a6426cd5-715b-45a2-a194-a03ce80438e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:44.022133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:44.023180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:44.024129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 431/887] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 11:59:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:44.025772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893836ec-45fa-4f84-bc53-faf872dcae0a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.025772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893836ec-45fa-4f84-bc53-faf872dcae0a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.025772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893836ec-45fa-4f84-bc53-faf872dcae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.046192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-893836ec-45fa-4f84-bc53-faf872dcae0a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:44.047398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-893836ec-45fa-4f84-bc53-faf872dcae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:44.063597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd476021-e1c4-4527-a8d7-e7df410139ec None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:44.099319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8189cce-3bb8-482d-976e-18bdb4afcacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.100000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189cce-3bb8-482d-976e-18bdb4afcacd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.100267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189cce-3bb8-482d-976e-18bdb4afcacd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.100543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189cce-3bb8-482d-976e-18bdb4afcacd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.101130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8189cce-3bb8-482d-976e-18bdb4afcacd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:44.102486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8189cce-3bb8-482d-976e-18bdb4afcacd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-f8189cce-3bb8-482d-976e-18bdb4afcacd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:44.113110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:44.114382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:59:44.115272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:44.119704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 457/888] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:59:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:44.120607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8189cce-3bb8-482d-976e-18bdb4afcacd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:44.128720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 432/889] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:44.132516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893836ec-45fa-4f84-bc53-faf872dcae0a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:44.234648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:44.237916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8189cce-3bb8-482d-976e-18bdb4afcacd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:44.254475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893836ec-45fa-4f84-bc53-faf872dcae0a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:44.267471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:44.273124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc97a27-beaf-4619-94bc-4c24e6aec808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.275753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc97a27-beaf-4619-94bc-4c24e6aec808 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.275753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc97a27-beaf-4619-94bc-4c24e6aec808 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.275753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc97a27-beaf-4619-94bc-4c24e6aec808 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.275753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc97a27-beaf-4619-94bc-4c24e6aec808 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:44.276061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc97a27-beaf-4619-94bc-4c24e6aec808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:44.277167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc97a27-beaf-4619-94bc-4c24e6aec808 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:44.285877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 458/890] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 11:59:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:44.291533 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc97a27-beaf-4619-94bc-4c24e6aec808 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:44.295655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d84f-96f0-49f5-8c38-f6e959c3cf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.296521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d84f-96f0-49f5-8c38-f6e959c3cf05 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.296990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d84f-96f0-49f5-8c38-f6e959c3cf05 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.297455 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d84f-96f0-49f5-8c38-f6e959c3cf05 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.298265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178d84f-96f0-49f5-8c38-f6e959c3cf05 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:44.298757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178d84f-96f0-49f5-8c38-f6e959c3cf05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:44.300415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178d84f-96f0-49f5-8c38-f6e959c3cf05 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:44.306171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 433/891] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:59:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:44.311440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d84f-96f0-49f5-8c38-f6e959c3cf05 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:44.423044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc97a27-beaf-4619-94bc-4c24e6aec808 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:44.440380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d84f-96f0-49f5-8c38-f6e959c3cf05 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:44.467681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b935d24-ef93-46af-b49c-e37979009e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.469038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b935d24-ef93-46af-b49c-e37979009e7a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.469038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b935d24-ef93-46af-b49c-e37979009e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.469038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b935d24-ef93-46af-b49c-e37979009e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.481431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b935d24-ef93-46af-b49c-e37979009e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:44.482894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b935d24-ef93-46af-b49c-e37979009e7a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:44.486366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3daea3-c56d-45ff-8b8c-845c71d06c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.486989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3daea3-c56d-45ff-8b8c-845c71d06c70 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.487273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3daea3-c56d-45ff-8b8c-845c71d06c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.487546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3daea3-c56d-45ff-8b8c-845c71d06c70 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.488205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3daea3-c56d-45ff-8b8c-845c71d06c70 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:44.488511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3daea3-c56d-45ff-8b8c-845c71d06c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:44.489862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3daea3-c56d-45ff-8b8c-845c71d06c70 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:44.495676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 434/892] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:59:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:44.496658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3daea3-c56d-45ff-8b8c-845c71d06c70 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-4b935d24-ef93-46af-b49c-e37979009e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:44.504980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:44.506002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:44.506933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:44.506933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:44.506933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:44.506933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 459/893] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:44.507168 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b935d24-ef93-46af-b49c-e37979009e7a None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:44.524472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:44.545699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:44.607910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3daea3-c56d-45ff-8b8c-845c71d06c70 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:44.612805 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b935d24-ef93-46af-b49c-e37979009e7a None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:44.643100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637f47b-b8b4-481c-8624-befa8f39bb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.643734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637f47b-b8b4-481c-8624-befa8f39bb16 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.644021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637f47b-b8b4-481c-8624-befa8f39bb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.644297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637f47b-b8b4-481c-8624-befa8f39bb16 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.644938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637f47b-b8b4-481c-8624-befa8f39bb16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:44.646299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637f47b-b8b4-481c-8624-befa8f39bb16 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:44.647195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea35894-f982-4a87-a7cd-c7614ea7b5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.647836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea35894-f982-4a87-a7cd-c7614ea7b5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.648117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea35894-f982-4a87-a7cd-c7614ea7b5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.648390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea35894-f982-4a87-a7cd-c7614ea7b5a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.649083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea35894-f982-4a87-a7cd-c7614ea7b5a9 None admin] RBAC: Adding query filter params (interface=public, service_id=b8678859f1524c87be9f2892ca86d94e, region_id=RegionOne) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:44.649418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea35894-f982-4a87-a7cd-c7614ea7b5a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:44.650925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea35894-f982-4a87-a7cd-c7614ea7b5a9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:44.655999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 460/894] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 11:59:44 2022] GET /identity/v3/endpoints?service_id=b8678859f1524c87be9f2892ca86d94e&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:44.656778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea35894-f982-4a87-a7cd-c7614ea7b5a9 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:44.717326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 435/895] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 11:59:44 2022] POST /identity/v3/services => generated 241 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:44.718492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8555f-9d7b-4a7d-afb8-fe6177308f05 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.718785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8555f-9d7b-4a7d-afb8-fe6177308f05 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.719062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8555f-9d7b-4a7d-afb8-fe6177308f05 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.720456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 436/896] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:44.725008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8555f-9d7b-4a7d-afb8-fe6177308f05 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:44.734063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:44.758122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea35894-f982-4a87-a7cd-c7614ea7b5a9 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:44.803402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eaaa7-9807-4035-ac36-102b63d8bde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.804054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eaaa7-9807-4035-ac36-102b63d8bde0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.804332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eaaa7-9807-4035-ac36-102b63d8bde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.804608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eaaa7-9807-4035-ac36-102b63d8bde0 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.805268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eaaa7-9807-4035-ac36-102b63d8bde0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:44.805569 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eaaa7-9807-4035-ac36-102b63d8bde0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:44.807527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eaaa7-9807-4035-ac36-102b63d8bde0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:44.823351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 461/897] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:44.823351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a52b-7164-40b4-9311-f56983f021d0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.823351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a52b-7164-40b4-9311-f56983f021d0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.823351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a52b-7164-40b4-9311-f56983f021d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.842194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-88e5a52b-7164-40b4-9311-f56983f021d0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:44.843417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-88e5a52b-7164-40b4-9311-f56983f021d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:44.848908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:44.854828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8555f-9d7b-4a7d-afb8-fe6177308f05 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:44.901799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d5978-ab0f-49aa-a9b2-83cdfedcd652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:44.902292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d5978-ab0f-49aa-a9b2-83cdfedcd652 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:44.902574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d5978-ab0f-49aa-a9b2-83cdfedcd652 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:44.902852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d5978-ab0f-49aa-a9b2-83cdfedcd652 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:44.903464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d5978-ab0f-49aa-a9b2-83cdfedcd652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:44.904874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d5978-ab0f-49aa-a9b2-83cdfedcd652 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:44.912187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 437/898] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 11:59:44 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:59:44.912997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d5978-ab0f-49aa-a9b2-83cdfedcd652 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:44.932403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 462/899] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:45.034342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d5978-ab0f-49aa-a9b2-83cdfedcd652 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:45.073532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6b010-4329-43c1-869e-fde3b4db9aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:45.074184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6b010-4329-43c1-869e-fde3b4db9aff None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:45.074465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6b010-4329-43c1-869e-fde3b4db9aff None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:45.074798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6b010-4329-43c1-869e-fde3b4db9aff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:45.083080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6b010-4329-43c1-869e-fde3b4db9aff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:45.084623 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6b010-4329-43c1-869e-fde3b4db9aff None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-1df6b010-4329-43c1-869e-fde3b4db9aff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:45.097120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:45.098107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:45.099057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:45.100921 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 438/900] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 11:59:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:45.107925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5a52b-7164-40b4-9311-f56983f021d0 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:45.176376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:45.207202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6b010-4329-43c1-869e-fde3b4db9aff None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:45.221991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5a52b-7164-40b4-9311-f56983f021d0 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:45.236808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:45.259823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d779f09-2db9-46f9-bfb8-3a7590be044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:45.260532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d779f09-2db9-46f9-bfb8-3a7590be044e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:45.260887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d779f09-2db9-46f9-bfb8-3a7590be044e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:45.261232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d779f09-2db9-46f9-bfb8-3a7590be044e None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:45.262032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d779f09-2db9-46f9-bfb8-3a7590be044e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:45.262405 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d779f09-2db9-46f9-bfb8-3a7590be044e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:45.263922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d779f09-2db9-46f9-bfb8-3a7590be044e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:45.284673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 463/901] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 11:59:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:45.291589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d779f09-2db9-46f9-bfb8-3a7590be044e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:45.326310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6b010-4329-43c1-869e-fde3b4db9aff None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:45.366620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132052ab-c964-4cc3-b33e-497e6aeb6c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:45.367336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132052ab-c964-4cc3-b33e-497e6aeb6c1e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:45.367637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132052ab-c964-4cc3-b33e-497e6aeb6c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:45.367910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132052ab-c964-4cc3-b33e-497e6aeb6c1e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:45.368520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132052ab-c964-4cc3-b33e-497e6aeb6c1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:45.370076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132052ab-c964-4cc3-b33e-497e6aeb6c1e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-132052ab-c964-4cc3-b33e-497e6aeb6c1e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:45.380055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:45.381045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:45.382282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 439/902] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Sep 9 11:59:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:45.386990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132052ab-c964-4cc3-b33e-497e6aeb6c1e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:45.421615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d779f09-2db9-46f9-bfb8-3a7590be044e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:45.450384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:45.467575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc334af1-2f7f-43f1-8129-639fa5c4045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:45.468234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc334af1-2f7f-43f1-8129-639fa5c4045f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:45.468846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc334af1-2f7f-43f1-8129-639fa5c4045f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:45.468846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc334af1-2f7f-43f1-8129-639fa5c4045f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:45.490121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:45.510063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132052ab-c964-4cc3-b33e-497e6aeb6c1e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:45.552761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc334af1-2f7f-43f1-8129-639fa5c4045f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:45.554112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc334af1-2f7f-43f1-8129-639fa5c4045f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:45.554503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b8ed-e39e-4118-b092-4185c9232560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:45.555339 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b8ed-e39e-4118-b092-4185c9232560 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:45.555833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b8ed-e39e-4118-b092-4185c9232560 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:45.556463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b8ed-e39e-4118-b092-4185c9232560 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:45.558105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636b8ed-e39e-4118-b092-4185c9232560 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:45.558619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636b8ed-e39e-4118-b092-4185c9232560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:45.560169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636b8ed-e39e-4118-b092-4185c9232560 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:45.566881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 440/903] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:45.572844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b8ed-e39e-4118-b092-4185c9232560 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:45.669569 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 464/904] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:45 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 11:59:45.676076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc334af1-2f7f-43f1-8129-639fa5c4045f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:45.703461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:45.721012 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b8ed-e39e-4118-b092-4185c9232560 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:45.769121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cb5e3-dd63-4fd7-a3e2-f0826deb2b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:45.769854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cb5e3-dd63-4fd7-a3e2-f0826deb2b68 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:45.770599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cb5e3-dd63-4fd7-a3e2-f0826deb2b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:45.770599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cb5e3-dd63-4fd7-a3e2-f0826deb2b68 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:45.771285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cb5e3-dd63-4fd7-a3e2-f0826deb2b68 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:45.771705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cb5e3-dd63-4fd7-a3e2-f0826deb2b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:45.773325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cb5e3-dd63-4fd7-a3e2-f0826deb2b68 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:45.784400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 441/905] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:45.785415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cb5e3-dd63-4fd7-a3e2-f0826deb2b68 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:45.804675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc334af1-2f7f-43f1-8129-639fa5c4045f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:45.805631 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:45.844197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1709960-3d2e-449a-8e2f-47f4da144d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:45.844917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1709960-3d2e-449a-8e2f-47f4da144d22 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:45.845200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1709960-3d2e-449a-8e2f-47f4da144d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:45.845470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1709960-3d2e-449a-8e2f-47f4da144d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:45.858898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1709960-3d2e-449a-8e2f-47f4da144d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:45.860470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1709960-3d2e-449a-8e2f-47f4da144d22 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-c1709960-3d2e-449a-8e2f-47f4da144d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:45.878043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:45.879064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:45.880021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:45.880021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:45.880021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:45.883950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 465/906] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:45.886048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1709960-3d2e-449a-8e2f-47f4da144d22 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:45.925180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cb5e3-dd63-4fd7-a3e2-f0826deb2b68 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:45.970419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3330a9c-6f4d-4623-9bc7-7a60665bb88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:45.971409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3330a9c-6f4d-4623-9bc7-7a60665bb88e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:45.971974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3330a9c-6f4d-4623-9bc7-7a60665bb88e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:45.976693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3330a9c-6f4d-4623-9bc7-7a60665bb88e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:45.976693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3330a9c-6f4d-4623-9bc7-7a60665bb88e None admin] RBAC: Adding query filter params (interface=public, service_id=9ae470b1fdd448b7ba762c333173dcd3, region_id=RegionOne) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:45.976693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3330a9c-6f4d-4623-9bc7-7a60665bb88e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:45.976955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:45.977035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3330a9c-6f4d-4623-9bc7-7a60665bb88e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:45.987721 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 442/907] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 11:59:45 2022] GET /identity/v3/endpoints?service_id=9ae470b1fdd448b7ba762c333173dcd3&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:45.989358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3330a9c-6f4d-4623-9bc7-7a60665bb88e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:46.009203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1709960-3d2e-449a-8e2f-47f4da144d22 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:46.050473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380d4f-160f-404b-b015-44dc292238b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:46.051343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380d4f-160f-404b-b015-44dc292238b8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:46.051647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380d4f-160f-404b-b015-44dc292238b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:46.051923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380d4f-160f-404b-b015-44dc292238b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:46.052658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81380d4f-160f-404b-b015-44dc292238b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:46.052966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81380d4f-160f-404b-b015-44dc292238b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:46.054570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81380d4f-160f-404b-b015-44dc292238b8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:46.075715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 466/908] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:46.079523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380d4f-160f-404b-b015-44dc292238b8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:46.098388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:46.124933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3330a9c-6f4d-4623-9bc7-7a60665bb88e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:46.165170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3509a99-a6ca-4071-960f-df77a2e92360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:46.166278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3509a99-a6ca-4071-960f-df77a2e92360 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:46.166769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3509a99-a6ca-4071-960f-df77a2e92360 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:46.167273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3509a99-a6ca-4071-960f-df77a2e92360 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:46.168273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3509a99-a6ca-4071-960f-df77a2e92360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:46.169845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3509a99-a6ca-4071-960f-df77a2e92360 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:46.177456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 443/909] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 11:59:45 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:59:46.203161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380d4f-160f-404b-b015-44dc292238b8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:46.243667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335f78c-d4a8-4b2a-823c-8168b7c3ce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:46.245342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335f78c-d4a8-4b2a-823c-8168b7c3ce8f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:46.245839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335f78c-d4a8-4b2a-823c-8168b7c3ce8f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:46.246358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335f78c-d4a8-4b2a-823c-8168b7c3ce8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:46.249051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:46.256406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335f78c-d4a8-4b2a-823c-8168b7c3ce8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335f78c-d4a8-4b2a-823c-8168b7c3ce8f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-9335f78c-d4a8-4b2a-823c-8168b7c3ce8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:46.278063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:46.278963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:46.280495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 467/910] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:46.283038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3509a99-a6ca-4071-960f-df77a2e92360 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:46.398006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3509a99-a6ca-4071-960f-df77a2e92360 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:46.435883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bdfd1-b67d-4306-bf26-60aad366ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:46.436882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bdfd1-b67d-4306-bf26-60aad366ae94 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:46.437409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bdfd1-b67d-4306-bf26-60aad366ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:46.437896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bdfd1-b67d-4306-bf26-60aad366ae94 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:46.438852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bdfd1-b67d-4306-bf26-60aad366ae94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:46.439381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bdfd1-b67d-4306-bf26-60aad366ae94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:46.441066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bdfd1-b67d-4306-bf26-60aad366ae94 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:46.458962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 444/911] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:46.461013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335f78c-d4a8-4b2a-823c-8168b7c3ce8f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:46.567335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335f78c-d4a8-4b2a-823c-8168b7c3ce8f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:46.604730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6815742-2729-4512-b7d2-262006ff2ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:46.605357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815742-2729-4512-b7d2-262006ff2ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:46.605642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815742-2729-4512-b7d2-262006ff2ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:46.605919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815742-2729-4512-b7d2-262006ff2ca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:46.606649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6815742-2729-4512-b7d2-262006ff2ca1 None admin] RBAC: Adding query filter params (role.id=6e4e3079bb5443eeabfe7d1c2cdb45f4, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=18bd4f37058e4019a1e5f13dfdcdc4ac) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:46.606961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6815742-2729-4512-b7d2-262006ff2ca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:46.608419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6815742-2729-4512-b7d2-262006ff2ca1 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:46.614953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 468/912] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:46 2022] GET /identity/v3/role_assignments?user.id=18bd4f37058e4019a1e5f13dfdcdc4ac&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=6e4e3079bb5443eeabfe7d1c2cdb45f4 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:47.051200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b042-39c9-457a-9d09-3fb29d75ffa9 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:47.051765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b042-39c9-457a-9d09-3fb29d75ffa9 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:47.051765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b042-39c9-457a-9d09-3fb29d75ffa9 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:47.053390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 445/913] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:47.059422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8eaef-f936-490c-b5b7-8fc598693067 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:47.060038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8eaef-f936-490c-b5b7-8fc598693067 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:47.060517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8eaef-f936-490c-b5b7-8fc598693067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:47.079245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-84d8eaef-f936-490c-b5b7-8fc598693067 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:47.080806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-84d8eaef-f936-490c-b5b7-8fc598693067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:47.146982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:47.153263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d4ec6-353d-488a-81b8-fdf56cd0730c None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:47.158635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d4ec6-353d-488a-81b8-fdf56cd0730c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:47.158635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d4ec6-353d-488a-81b8-fdf56cd0730c None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:47.158635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 446/914] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:59:47.161113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31533b8b-8bb9-4c04-ac7d-93463f6eb75c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:47.161481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31533b8b-8bb9-4c04-ac7d-93463f6eb75c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:47.161767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31533b8b-8bb9-4c04-ac7d-93463f6eb75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:47.162259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 469/915] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:59:47.168888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:47.181756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-31533b8b-8bb9-4c04-ac7d-93463f6eb75c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:47.182950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-31533b8b-8bb9-4c04-ac7d-93463f6eb75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:47.252771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 447/916] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:59:47.433468 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8eaef-f936-490c-b5b7-8fc598693067 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:47.527363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31533b8b-8bb9-4c04-ac7d-93463f6eb75c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:47.543134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8eaef-f936-490c-b5b7-8fc598693067 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:47.582164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63332d9-d4f2-48e1-a56b-2de2ac23da49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:47.582804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63332d9-d4f2-48e1-a56b-2de2ac23da49 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:47.583078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63332d9-d4f2-48e1-a56b-2de2ac23da49 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:47.583409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63332d9-d4f2-48e1-a56b-2de2ac23da49 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:47.584037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63332d9-d4f2-48e1-a56b-2de2ac23da49 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:47.585412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63332d9-d4f2-48e1-a56b-2de2ac23da49 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-f63332d9-d4f2-48e1-a56b-2de2ac23da49 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:47.596706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:47.597748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:47.598600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 470/917] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:47.604118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63332d9-d4f2-48e1-a56b-2de2ac23da49 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:47.646219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31533b8b-8bb9-4c04-ac7d-93463f6eb75c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:47.675203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:47.680901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:47.696132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4eb30c-615b-4c38-ae0e-5523ab3e7f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:47.696132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4eb30c-615b-4c38-ae0e-5523ab3e7f75 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:47.696132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4eb30c-615b-4c38-ae0e-5523ab3e7f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:47.696132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4eb30c-615b-4c38-ae0e-5523ab3e7f75 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:47.696527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4eb30c-615b-4c38-ae0e-5523ab3e7f75 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:47.696527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4eb30c-615b-4c38-ae0e-5523ab3e7f75 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-be4eb30c-615b-4c38-ae0e-5523ab3e7f75 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:47.699445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:47.700556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:59:47.701392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:47.708864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 448/918] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:59:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:47.709992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4eb30c-615b-4c38-ae0e-5523ab3e7f75 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:47.730895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63332d9-d4f2-48e1-a56b-2de2ac23da49 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:47.778504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970075f-464c-416a-8fcc-1a81e51547b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:47.779121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970075f-464c-416a-8fcc-1a81e51547b4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:47.779461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970075f-464c-416a-8fcc-1a81e51547b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:47.780157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970075f-464c-416a-8fcc-1a81e51547b4 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:47.780898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970075f-464c-416a-8fcc-1a81e51547b4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:47.781211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970075f-464c-416a-8fcc-1a81e51547b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:47.782701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970075f-464c-416a-8fcc-1a81e51547b4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:47.790398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 471/919] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:47.796172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970075f-464c-416a-8fcc-1a81e51547b4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:47.844181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4eb30c-615b-4c38-ae0e-5523ab3e7f75 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:47.879912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87818efb-cec1-4bd4-aa99-43179b100a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:47.880538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87818efb-cec1-4bd4-aa99-43179b100a1c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:47.880799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87818efb-cec1-4bd4-aa99-43179b100a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:47.881129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87818efb-cec1-4bd4-aa99-43179b100a1c None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:47.881979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87818efb-cec1-4bd4-aa99-43179b100a1c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:47.882106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87818efb-cec1-4bd4-aa99-43179b100a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:47.883405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87818efb-cec1-4bd4-aa99-43179b100a1c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:47.889135 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 449/920] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:59:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:47.894852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87818efb-cec1-4bd4-aa99-43179b100a1c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:47.939679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970075f-464c-416a-8fcc-1a81e51547b4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:47.959847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:47.961603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:47.985398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22edd41-5e7a-41fc-aa9d-2fb296873c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:47.986355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22edd41-5e7a-41fc-aa9d-2fb296873c66 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:47.986783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22edd41-5e7a-41fc-aa9d-2fb296873c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:47.990087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22edd41-5e7a-41fc-aa9d-2fb296873c66 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:47.990087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22edd41-5e7a-41fc-aa9d-2fb296873c66 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:47.990087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22edd41-5e7a-41fc-aa9d-2fb296873c66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:47.990087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22edd41-5e7a-41fc-aa9d-2fb296873c66 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:47.997579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 472/921] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:48.004732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22edd41-5e7a-41fc-aa9d-2fb296873c66 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:48.008945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87818efb-cec1-4bd4-aa99-43179b100a1c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:48.047361 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b479a3-83c9-4b95-8676-56558b070b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:48.048119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b479a3-83c9-4b95-8676-56558b070b5e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:48.048469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b479a3-83c9-4b95-8676-56558b070b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:48.048812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b479a3-83c9-4b95-8676-56558b070b5e None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:48.049513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b479a3-83c9-4b95-8676-56558b070b5e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:48.049886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b479a3-83c9-4b95-8676-56558b070b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:48.051323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b479a3-83c9-4b95-8676-56558b070b5e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:48.062222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 450/922] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 11:59:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:48.064055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b479a3-83c9-4b95-8676-56558b070b5e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:48.140546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22edd41-5e7a-41fc-aa9d-2fb296873c66 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:48.174210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b479a3-83c9-4b95-8676-56558b070b5e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:48.183497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf030de-5484-4a53-8815-9e2dce23e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:48.184324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf030de-5484-4a53-8815-9e2dce23e839 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:48.184606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf030de-5484-4a53-8815-9e2dce23e839 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:48.184880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf030de-5484-4a53-8815-9e2dce23e839 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:48.185583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf030de-5484-4a53-8815-9e2dce23e839 None admin] RBAC: Adding query filter params (interface=public, service_id=27550394c58046068ee24cbaa720f267, region_id=RegionOne) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:48.185891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf030de-5484-4a53-8815-9e2dce23e839 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:48.188470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf030de-5484-4a53-8815-9e2dce23e839 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:48.199575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 473/923] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 11:59:48 2022] GET /identity/v3/endpoints?service_id=27550394c58046068ee24cbaa720f267&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:48.200882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf030de-5484-4a53-8815-9e2dce23e839 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:48.203327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:48.224249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b3815-1ced-4e66-81f4-cc461660e6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:48.224249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b3815-1ced-4e66-81f4-cc461660e6c3 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:48.224249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b3815-1ced-4e66-81f4-cc461660e6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:48.224249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b3815-1ced-4e66-81f4-cc461660e6c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:48.224658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b3815-1ced-4e66-81f4-cc461660e6c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:48.224658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b3815-1ced-4e66-81f4-cc461660e6c3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:48.251815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:48.308995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf030de-5484-4a53-8815-9e2dce23e839 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:48.319653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 451/924] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 11:59:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:59:48.359515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83988a5b-d270-4192-8dc5-acbde7a636ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:48.360184 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988a5b-d270-4192-8dc5-acbde7a636ff None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:48.360554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988a5b-d270-4192-8dc5-acbde7a636ff None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:48.360890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988a5b-d270-4192-8dc5-acbde7a636ff None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:48.361548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83988a5b-d270-4192-8dc5-acbde7a636ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:48.362927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83988a5b-d270-4192-8dc5-acbde7a636ff None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:48.375889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 474/925] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 11:59:48 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:59:48.519946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964af75-5bc2-41e8-9c25-2c5f47659e04 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:48.520251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964af75-5bc2-41e8-9c25-2c5f47659e04 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:48.520456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964af75-5bc2-41e8-9c25-2c5f47659e04 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:48.522372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 452/926] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:48.530466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e81e-3515-43b1-9070-fcc88e80614d None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:48.530773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e81e-3515-43b1-9070-fcc88e80614d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:48.531022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e81e-3515-43b1-9070-fcc88e80614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:48.551000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b971e81e-3515-43b1-9070-fcc88e80614d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:48.552259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b971e81e-3515-43b1-9070-fcc88e80614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:48.631706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 475/927] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:48.858160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e9d42-8b2e-4a5b-87f3-6756edbc213d None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:48.858559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e9d42-8b2e-4a5b-87f3-6756edbc213d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:48.858743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e9d42-8b2e-4a5b-87f3-6756edbc213d None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:48.860347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 453/928] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:48.865849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095436-266b-4522-be9e-f77766f7501d None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:48.866132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095436-266b-4522-be9e-f77766f7501d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:48.866412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095436-266b-4522-be9e-f77766f7501d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:48.886981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3d095436-266b-4522-be9e-f77766f7501d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:48.888203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3d095436-266b-4522-be9e-f77766f7501d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:48.917999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:48.925119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e9d42-8b2e-4a5b-87f3-6756edbc213d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:48.967830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 476/929] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:49.049568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e9d42-8b2e-4a5b-87f3-6756edbc213d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:49.084687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27484e65-b5ca-4288-bb64-a20f80d85a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:49.085372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27484e65-b5ca-4288-bb64-a20f80d85a20 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:49.085588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27484e65-b5ca-4288-bb64-a20f80d85a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:49.085869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27484e65-b5ca-4288-bb64-a20f80d85a20 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:49.086451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27484e65-b5ca-4288-bb64-a20f80d85a20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:49.088404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27484e65-b5ca-4288-bb64-a20f80d85a20 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-27484e65-b5ca-4288-bb64-a20f80d85a20 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:49.097748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:49.098753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:59:49.099718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:49.102678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 454/930] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Sep 9 11:59:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:49.105815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095436-266b-4522-be9e-f77766f7501d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:49.211980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095436-266b-4522-be9e-f77766f7501d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:49.245341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27484e65-b5ca-4288-bb64-a20f80d85a20 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:49.252023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003da5e0-982f-4c01-a68a-134a90b7122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:49.252655 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003da5e0-982f-4c01-a68a-134a90b7122e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:49.252935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003da5e0-982f-4c01-a68a-134a90b7122e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:49.253210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003da5e0-982f-4c01-a68a-134a90b7122e None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:49.253848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003da5e0-982f-4c01-a68a-134a90b7122e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:49.254150 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003da5e0-982f-4c01-a68a-134a90b7122e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:49.255513 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003da5e0-982f-4c01-a68a-134a90b7122e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:49.267727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 477/931] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:49.268985 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003da5e0-982f-4c01-a68a-134a90b7122e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:49.298934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:49.311988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:49.382659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003da5e0-982f-4c01-a68a-134a90b7122e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:49.386799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27484e65-b5ca-4288-bb64-a20f80d85a20 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:49.420961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b170c96-a4a5-4b01-97b7-fe67697a6fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:49.421628 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170c96-a4a5-4b01-97b7-fe67697a6fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:49.421926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170c96-a4a5-4b01-97b7-fe67697a6fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:49.422192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170c96-a4a5-4b01-97b7-fe67697a6fe9 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:49.422847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170c96-a4a5-4b01-97b7-fe67697a6fe9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:49.423159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170c96-a4a5-4b01-97b7-fe67697a6fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:49.424843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170c96-a4a5-4b01-97b7-fe67697a6fe9 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:49.435339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 478/932] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:49.435518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b85f1-4f13-4400-aaf3-fa85cc5e25b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:49.435518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b85f1-4f13-4400-aaf3-fa85cc5e25b3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:49.435518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b85f1-4f13-4400-aaf3-fa85cc5e25b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:49.435518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b85f1-4f13-4400-aaf3-fa85cc5e25b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:49.437444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b170c96-a4a5-4b01-97b7-fe67697a6fe9 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:49.450842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b85f1-4f13-4400-aaf3-fa85cc5e25b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-078b85f1-4f13-4400-aaf3-fa85cc5e25b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:49.457572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:49.458536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:59:49.459376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:49.461225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 455/933] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 11:59:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:49.469599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b85f1-4f13-4400-aaf3-fa85cc5e25b3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:49.553756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:49.565413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b170c96-a4a5-4b01-97b7-fe67697a6fe9 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:49.607790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c35e51-155e-4f0a-b564-fc1bcf7c9b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:49.608899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35e51-155e-4f0a-b564-fc1bcf7c9b15 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:49.609408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35e51-155e-4f0a-b564-fc1bcf7c9b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:49.610142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35e51-155e-4f0a-b564-fc1bcf7c9b15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:49.611253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c35e51-155e-4f0a-b564-fc1bcf7c9b15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:49.612655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b85f1-4f13-4400-aaf3-fa85cc5e25b3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:49.613003 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c35e51-155e-4f0a-b564-fc1bcf7c9b15 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:49.615150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:49.658005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d893cf-5fd9-4e45-88f4-0179844cafe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:49.658534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d893cf-5fd9-4e45-88f4-0179844cafe3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:49.658812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d893cf-5fd9-4e45-88f4-0179844cafe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:49.659082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d893cf-5fd9-4e45-88f4-0179844cafe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:49.659778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d893cf-5fd9-4e45-88f4-0179844cafe3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:49.660104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d893cf-5fd9-4e45-88f4-0179844cafe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:49.661458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d893cf-5fd9-4e45-88f4-0179844cafe3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:49.671194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 456/934] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 11:59:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:49.678039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d893cf-5fd9-4e45-88f4-0179844cafe3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:49.707663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 479/935] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 11:59:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:59:49.810557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d893cf-5fd9-4e45-88f4-0179844cafe3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:49.856764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d519a0-c1ce-44a1-80a8-725b003b99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:49.857735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d519a0-c1ce-44a1-80a8-725b003b99f5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:49.858240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d519a0-c1ce-44a1-80a8-725b003b99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:49.858824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d519a0-c1ce-44a1-80a8-725b003b99f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:49.873005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d519a0-c1ce-44a1-80a8-725b003b99f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:49.874826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d519a0-c1ce-44a1-80a8-725b003b99f5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-01d519a0-c1ce-44a1-80a8-725b003b99f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:49.894298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:49.895364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:49.896320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:49.896320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:49.896320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:49.898275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 457/936] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:49.904905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c35e51-155e-4f0a-b564-fc1bcf7c9b15 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:50.011129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c35e51-155e-4f0a-b564-fc1bcf7c9b15 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:50.048039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34cd2-9f1b-4fc8-b2de-897d05352d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:50.048988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34cd2-9f1b-4fc8-b2de-897d05352d71 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.049428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34cd2-9f1b-4fc8-b2de-897d05352d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.049852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34cd2-9f1b-4fc8-b2de-897d05352d71 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.050643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34cd2-9f1b-4fc8-b2de-897d05352d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:50.051098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34cd2-9f1b-4fc8-b2de-897d05352d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:50.052703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34cd2-9f1b-4fc8-b2de-897d05352d71 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:50.070024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 480/937] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:50.075781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d519a0-c1ce-44a1-80a8-725b003b99f5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:50.094409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:50.202211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d519a0-c1ce-44a1-80a8-725b003b99f5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:50.237074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7c65-a7fd-4b08-bd2d-a90894e807dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:50.237707 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7c65-a7fd-4b08-bd2d-a90894e807dc None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.237987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7c65-a7fd-4b08-bd2d-a90894e807dc None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.238260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7c65-a7fd-4b08-bd2d-a90894e807dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.246019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d7c65-a7fd-4b08-bd2d-a90894e807dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:50.247460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d7c65-a7fd-4b08-bd2d-a90894e807dc None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-943d7c65-a7fd-4b08-bd2d-a90894e807dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:50.260342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:50.261386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:50.262358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 458/938] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 11:59:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:50.269456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34cd2-9f1b-4fc8-b2de-897d05352d71 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:50.286411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:50.379202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34cd2-9f1b-4fc8-b2de-897d05352d71 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:50.414701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0de0e-eb37-4fb3-bd3f-c7228c3b0401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:50.415311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0de0e-eb37-4fb3-bd3f-c7228c3b0401 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.415591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0de0e-eb37-4fb3-bd3f-c7228c3b0401 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.416042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0de0e-eb37-4fb3-bd3f-c7228c3b0401 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.416906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0de0e-eb37-4fb3-bd3f-c7228c3b0401 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:50.417224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0de0e-eb37-4fb3-bd3f-c7228c3b0401 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:50.418654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0de0e-eb37-4fb3-bd3f-c7228c3b0401 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:50.440993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 481/939] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 11:59:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:50.446730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7c65-a7fd-4b08-bd2d-a90894e807dc None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:50.529450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:50.559737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7c65-a7fd-4b08-bd2d-a90894e807dc None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:50.603483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e5655-404d-4e11-8966-43696150ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:50.604161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5655-404d-4e11-8966-43696150ff3e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.604451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5655-404d-4e11-8966-43696150ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.604728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5655-404d-4e11-8966-43696150ff3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.616811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5655-404d-4e11-8966-43696150ff3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:50.618262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5655-404d-4e11-8966-43696150ff3e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-449e5655-404d-4e11-8966-43696150ff3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:50.634007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:50.635752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:50.636744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:50.636744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:50.636744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:50.636744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 459/940] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:50.641543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0de0e-eb37-4fb3-bd3f-c7228c3b0401 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:50.659377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a0ce-e419-4f82-a90b-096f84d2e299 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.659693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a0ce-e419-4f82-a90b-096f84d2e299 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.659974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a0ce-e419-4f82-a90b-096f84d2e299 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.661598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 460/941] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:59:50.666909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3a71a-49eb-465d-a1a3-6da3f5e8e7b1 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.667193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3a71a-49eb-465d-a1a3-6da3f5e8e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.667473 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3a71a-49eb-465d-a1a3-6da3f5e8e7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.688094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-97c3a71a-49eb-465d-a1a3-6da3f5e8e7b1 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:50.689592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-97c3a71a-49eb-465d-a1a3-6da3f5e8e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:50.716277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:50.757036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0de0e-eb37-4fb3-bd3f-c7228c3b0401 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:50.765293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 461/942] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:59:50.768909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e02258-09b6-4010-a82b-7026ff822c86 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.769191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e02258-09b6-4010-a82b-7026ff822c86 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.769461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e02258-09b6-4010-a82b-7026ff822c86 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.770939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 462/943] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:50.776195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d315e-199c-4a3d-b54e-aa7430eec0b0 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.776479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d315e-199c-4a3d-b54e-aa7430eec0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.776753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d315e-199c-4a3d-b54e-aa7430eec0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.795240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f41d315e-199c-4a3d-b54e-aa7430eec0b0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:50.796435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f41d315e-199c-4a3d-b54e-aa7430eec0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:50.802024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bd19f-0b76-4981-97a7-169f8f565135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:50.802884 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bd19f-0b76-4981-97a7-169f8f565135 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.803381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bd19f-0b76-4981-97a7-169f8f565135 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.803875 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bd19f-0b76-4981-97a7-169f8f565135 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.805107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bd19f-0b76-4981-97a7-169f8f565135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:50.805615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bd19f-0b76-4981-97a7-169f8f565135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:50.808115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bd19f-0b76-4981-97a7-169f8f565135 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:50.826122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 482/944] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:50.831365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bd19f-0b76-4981-97a7-169f8f565135 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:50.853475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:50.879945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 463/945] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:59:50.951073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bd19f-0b76-4981-97a7-169f8f565135 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:50.977735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:50.986703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a23080-b528-4879-a48f-a167e1addb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:50.987585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a23080-b528-4879-a48f-a167e1addb7d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:50.988030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a23080-b528-4879-a48f-a167e1addb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:50.988458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a23080-b528-4879-a48f-a167e1addb7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:50.995335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a23080-b528-4879-a48f-a167e1addb7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:50.996971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a23080-b528-4879-a48f-a167e1addb7d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-b2a23080-b528-4879-a48f-a167e1addb7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:51.008719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:51.010557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:51.011723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:51.011723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:51.011723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:51.011723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:51.011723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:51.011723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:51.011723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:51.011723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:51.013869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 483/946] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:51.019993 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d315e-199c-4a3d-b54e-aa7430eec0b0 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:51.037510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a23080-b528-4879-a48f-a167e1addb7d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:51.138474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d315e-199c-4a3d-b54e-aa7430eec0b0 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:51.157903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a23080-b528-4879-a48f-a167e1addb7d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:51.176086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6f68-bdd6-49aa-8d8d-e0192df2e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:51.177091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6f68-bdd6-49aa-8d8d-e0192df2e739 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:51.177383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6f68-bdd6-49aa-8d8d-e0192df2e739 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:51.177664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6f68-bdd6-49aa-8d8d-e0192df2e739 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:51.178360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6f68-bdd6-49aa-8d8d-e0192df2e739 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:51.178673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6f68-bdd6-49aa-8d8d-e0192df2e739 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:51.180147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6f68-bdd6-49aa-8d8d-e0192df2e739 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:51.193730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 464/947] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:51.194567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6f68-bdd6-49aa-8d8d-e0192df2e739 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:51.201008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:51.201892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:51.202408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:51.202879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:51.203776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:51.205512 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:51.208688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WARNING keystone.server.flask.common [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 11:59:51.245068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:51.260570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.sql.core [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:59:51.260570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 11:59:51.260570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [parameters: {'id': 'df8004800da94c849b44c96ceff5c161', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 11:59:51.260570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81774) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df8004800da94c849b44c96ceff5c161.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df8004800da94c849b44c96ceff5c161. Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:59:51.277083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application result.read() Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 11:59:51.278134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application yield resource Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise self.value Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application session.commit() Sep 09 11:59:51.279163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:59:51.280541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:59:51.281803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application result.read() Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:59:51.283523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [parameters: {'id': 'df8004800da94c849b44c96ceff5c161', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:51.284652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:51.285635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df8004800da94c849b44c96ceff5c161. Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 484/948] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Sep 9 11:59:51 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:51.286777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:51.313624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6f68-bdd6-49aa-8d8d-e0192df2e739 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:51.334020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:51.349898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3ead1-c4b7-4d82-97b1-2acd50af768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:51.350530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3ead1-c4b7-4d82-97b1-2acd50af768c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:51.350818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3ead1-c4b7-4d82-97b1-2acd50af768c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:51.351087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3ead1-c4b7-4d82-97b1-2acd50af768c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:51.351692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3ead1-c4b7-4d82-97b1-2acd50af768c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:51.353121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3ead1-c4b7-4d82-97b1-2acd50af768c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-d9a3ead1-c4b7-4d82-97b1-2acd50af768c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:51.362029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:51.363108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:51.364022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 465/949] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:51.365395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3ead1-c4b7-4d82-97b1-2acd50af768c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:51.401516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6966-f102-42e9-bdec-779acd9f85e1 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:51.446667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006a856-f369-4c7f-aebc-28a8442e8ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:51.447963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006a856-f369-4c7f-aebc-28a8442e8ff7 None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:51.448281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006a856-f369-4c7f-aebc-28a8442e8ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:51.448565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006a856-f369-4c7f-aebc-28a8442e8ff7 None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/18bd4f37058e4019a1e5f13dfdcdc4ac/roles/6e4e3079bb5443eeabfe7d1c2cdb45f4` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:51.450953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006a856-f369-4c7f-aebc-28a8442e8ff7 None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=18bd4f37058e4019a1e5f13dfdcdc4ac, role_id=6e4e3079bb5443eeabfe7d1c2cdb45f4)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:51.452605 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006a856-f369-4c7f-aebc-28a8442e8ff7 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:51.471750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3ead1-c4b7-4d82-97b1-2acd50af768c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:51.483444 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:51.507257 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6621-1a8d-4f83-9a96-844c57324efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:51.507917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6621-1a8d-4f83-9a96-844c57324efb None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:51.508202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6621-1a8d-4f83-9a96-844c57324efb None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:51.508480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6621-1a8d-4f83-9a96-844c57324efb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:51.515653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6621-1a8d-4f83-9a96-844c57324efb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:51.517175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6621-1a8d-4f83-9a96-844c57324efb None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-a9ee6621-1a8d-4f83-9a96-844c57324efb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:51.528668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:51.540929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 466/950] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:51.541937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6621-1a8d-4f83-9a96-844c57324efb None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:51.542511 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 485/951] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 11:59:51 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/18bd4f37058e4019a1e5f13dfdcdc4ac/roles/6e4e3079bb5443eeabfe7d1c2cdb45f4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:59:51.542511 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006a856-f369-4c7f-aebc-28a8442e8ff7 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:51.652454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6621-1a8d-4f83-9a96-844c57324efb None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:51.687474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006a856-f369-4c7f-aebc-28a8442e8ff7 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:51.689226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:51.693199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dd920-6d46-42b0-998c-54fbccd0c2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:51.693827 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dd920-6d46-42b0-998c-54fbccd0c2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:51.694111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dd920-6d46-42b0-998c-54fbccd0c2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:51.694386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dd920-6d46-42b0-998c-54fbccd0c2a3 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:51.695031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dd920-6d46-42b0-998c-54fbccd0c2a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:51.695339 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dd920-6d46-42b0-998c-54fbccd0c2a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:51.696766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dd920-6d46-42b0-998c-54fbccd0c2a3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:51.702766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 467/952] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:51.708390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dd920-6d46-42b0-998c-54fbccd0c2a3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:51.735473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc59f6b-e00e-48d8-96be-bf1b94187dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:51.736460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc59f6b-e00e-48d8-96be-bf1b94187dca None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:51.737115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc59f6b-e00e-48d8-96be-bf1b94187dca None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:51.737702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc59f6b-e00e-48d8-96be-bf1b94187dca None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:51.740070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc59f6b-e00e-48d8-96be-bf1b94187dca None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:51.740774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc59f6b-e00e-48d8-96be-bf1b94187dca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:51.742708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc59f6b-e00e-48d8-96be-bf1b94187dca None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:51.750449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:51.770070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 486/953] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:51.844328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dd920-6d46-42b0-998c-54fbccd0c2a3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:51.885341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed2f52-bb96-42f6-91d7-632d73fa86d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:51.886378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed2f52-bb96-42f6-91d7-632d73fa86d0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:51.886867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed2f52-bb96-42f6-91d7-632d73fa86d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:51.887345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed2f52-bb96-42f6-91d7-632d73fa86d0 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:51.888253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed2f52-bb96-42f6-91d7-632d73fa86d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:51.888765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed2f52-bb96-42f6-91d7-632d73fa86d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:51.890584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed2f52-bb96-42f6-91d7-632d73fa86d0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:51.897252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 468/954] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:51.903799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc59f6b-e00e-48d8-96be-bf1b94187dca None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:52.030091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc59f6b-e00e-48d8-96be-bf1b94187dca None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:52.069647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218de17-ffc1-4c31-8ca2-88b90146c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:52.070668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218de17-ffc1-4c31-8ca2-88b90146c2fd None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:52.071099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218de17-ffc1-4c31-8ca2-88b90146c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:52.071524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218de17-ffc1-4c31-8ca2-88b90146c2fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:52.072417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218de17-ffc1-4c31-8ca2-88b90146c2fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:52.073933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218de17-ffc1-4c31-8ca2-88b90146c2fd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:52.085120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a764d0-5851-4d73-b13e-ae5a965d044a None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:52.085735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a764d0-5851-4d73-b13e-ae5a965d044a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:52.086214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a764d0-5851-4d73-b13e-ae5a965d044a None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:52.089867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 469/955] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:52.095314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa2bbb-3a5f-4682-96e2-5e6078b9a671 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:52.095643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa2bbb-3a5f-4682-96e2-5e6078b9a671 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:52.095940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa2bbb-3a5f-4682-96e2-5e6078b9a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:52.118439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-0eaa2bbb-3a5f-4682-96e2-5e6078b9a671 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:52.119743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0eaa2bbb-3a5f-4682-96e2-5e6078b9a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:52.171753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 487/956] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 11:59:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:52.211106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 470/957] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:59:52.482992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218de17-ffc1-4c31-8ca2-88b90146c2fd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:52.507310 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:52.593172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218de17-ffc1-4c31-8ca2-88b90146c2fd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:52.628452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c6c46-79ad-4f62-b113-e7306d3fa20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:52.629547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6c46-79ad-4f62-b113-e7306d3fa20e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:52.630046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6c46-79ad-4f62-b113-e7306d3fa20e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:52.630526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6c46-79ad-4f62-b113-e7306d3fa20e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:52.631415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c6c46-79ad-4f62-b113-e7306d3fa20e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:52.633007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c6c46-79ad-4f62-b113-e7306d3fa20e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-9b2c6c46-79ad-4f62-b113-e7306d3fa20e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:52.643167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:52.644315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:59:52.645189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:52.648048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 488/958] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:52.654444 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa2bbb-3a5f-4682-96e2-5e6078b9a671 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:52.682351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:52.762433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa2bbb-3a5f-4682-96e2-5e6078b9a671 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:52.798735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83953c86-153a-4542-968b-6ddf78b99c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:52.799907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953c86-153a-4542-968b-6ddf78b99c6e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:52.800424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953c86-153a-4542-968b-6ddf78b99c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:52.800932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953c86-153a-4542-968b-6ddf78b99c6e None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:52.802015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83953c86-153a-4542-968b-6ddf78b99c6e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:52.802696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83953c86-153a-4542-968b-6ddf78b99c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:52.804299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83953c86-153a-4542-968b-6ddf78b99c6e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:52.810286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 471/959] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:52.819567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c6c46-79ad-4f62-b113-e7306d3fa20e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:52.910482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:52.930155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c6c46-79ad-4f62-b113-e7306d3fa20e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:52.965220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102c23-07f7-49fd-941b-bacc111cd525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:52.965843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102c23-07f7-49fd-941b-bacc111cd525 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:52.966124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102c23-07f7-49fd-941b-bacc111cd525 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:52.966399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102c23-07f7-49fd-941b-bacc111cd525 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:52.967117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32102c23-07f7-49fd-941b-bacc111cd525 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:52.967430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32102c23-07f7-49fd-941b-bacc111cd525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:52.968815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32102c23-07f7-49fd-941b-bacc111cd525 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:52.973745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 489/960] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:53.824345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c2bf-c723-4efb-8261-0ff85896b37a None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:53.824897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c2bf-c723-4efb-8261-0ff85896b37a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:53.824897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c2bf-c723-4efb-8261-0ff85896b37a None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:53.826427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 472/961] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:53.832080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c37bbc-61f6-4721-bfa5-7a06a3885061 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:53.832491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c37bbc-61f6-4721-bfa5-7a06a3885061 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:53.832636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c37bbc-61f6-4721-bfa5-7a06a3885061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:53.851006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f8c37bbc-61f6-4721-bfa5-7a06a3885061 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:53.852557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f8c37bbc-61f6-4721-bfa5-7a06a3885061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:53.927411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 490/962] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:54.173341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57201a95-b894-4243-97f8-28ef62b2fb83 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:54.173813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57201a95-b894-4243-97f8-28ef62b2fb83 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:54.174186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57201a95-b894-4243-97f8-28ef62b2fb83 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:54.175654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 473/963] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:54.181192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725a1f-8e34-4ddb-9168-022750d38bfd None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:54.181484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725a1f-8e34-4ddb-9168-022750d38bfd None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:54.182319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725a1f-8e34-4ddb-9168-022750d38bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:54.200725 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-7e725a1f-8e34-4ddb-9168-022750d38bfd None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:54.202008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7e725a1f-8e34-4ddb-9168-022750d38bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:54.203090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57201a95-b894-4243-97f8-28ef62b2fb83 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:54.289205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 491/964] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:54.316479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:54.323911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57201a95-b894-4243-97f8-28ef62b2fb83 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:54.361393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7a665-5546-4f13-9848-f2dfd2f2506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:54.362038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7a665-5546-4f13-9848-f2dfd2f2506d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:54.362323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7a665-5546-4f13-9848-f2dfd2f2506d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:54.362661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7a665-5546-4f13-9848-f2dfd2f2506d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:54.373635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7a665-5546-4f13-9848-f2dfd2f2506d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4ab7a665-5546-4f13-9848-f2dfd2f2506d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:59:54.378777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:54.379995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:54.381041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 474/965] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 11:59:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:54.386251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725a1f-8e34-4ddb-9168-022750d38bfd None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:54.404017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:54.429891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000ecd5-ca8d-46f1-8238-e5d45c29e42c None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:54.430351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000ecd5-ca8d-46f1-8238-e5d45c29e42c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:54.430729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000ecd5-ca8d-46f1-8238-e5d45c29e42c None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:54.436346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 475/966] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:59:54.438007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cac5d-2d89-445a-9009-4e546c14fe06 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:54.438303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cac5d-2d89-445a-9009-4e546c14fe06 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:54.438580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cac5d-2d89-445a-9009-4e546c14fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:54.458526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ca7cac5d-2d89-445a-9009-4e546c14fe06 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:54.460573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ca7cac5d-2d89-445a-9009-4e546c14fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:54.498028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725a1f-8e34-4ddb-9168-022750d38bfd None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:54.535279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee350c-6f52-47fd-bf02-2d816c807f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:54.535947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee350c-6f52-47fd-bf02-2d816c807f9f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:54.536230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee350c-6f52-47fd-bf02-2d816c807f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:54.536507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee350c-6f52-47fd-bf02-2d816c807f9f None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:54.537403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 476/967] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:59:54.539737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee350c-6f52-47fd-bf02-2d816c807f9f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:54.540174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee350c-6f52-47fd-bf02-2d816c807f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:54.542244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee350c-6f52-47fd-bf02-2d816c807f9f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:54.551033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 492/968] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 11:59:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:54.556935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cac5d-2d89-445a-9009-4e546c14fe06 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:54.581124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee350c-6f52-47fd-bf02-2d816c807f9f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:54.640990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:54.662558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:54.669957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cac5d-2d89-445a-9009-4e546c14fe06 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:54.712551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee350c-6f52-47fd-bf02-2d816c807f9f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:54.713492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9a0d-f5a6-4fc1-a65f-d16d65d21c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:54.714139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9a0d-f5a6-4fc1-a65f-d16d65d21c82 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:54.714417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9a0d-f5a6-4fc1-a65f-d16d65d21c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:54.714688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9a0d-f5a6-4fc1-a65f-d16d65d21c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:54.725915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a9a0d-f5a6-4fc1-a65f-d16d65d21c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:54.727354 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a9a0d-f5a6-4fc1-a65f-d16d65d21c82 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-5b9a9a0d-f5a6-4fc1-a65f-d16d65d21c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:54.742648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:54.743646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:54.744617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:54.744617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:54.744617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:54.748618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 477/969] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:54.749754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9a0d-f5a6-4fc1-a65f-d16d65d21c82 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:54.754620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:54.755253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:54.755542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:54.755868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:54.756537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:54.757968 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:54.840696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.sql.core [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:59:54.840696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 11:59:54.840696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [parameters: {'user_id': '3168bf7c30dc4a8b9f8762c0367b9fa9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 11:59:54.840696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81774) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application result.read() Sep 09 11:59:54.853545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:59:54.855696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application yield resource Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise self.value Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application session.commit() Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:59:54.860527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:59:54.863377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:59:54.866523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application result.read() Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:59:54.869891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [parameters: {'user_id': '3168bf7c30dc4a8b9f8762c0367b9fa9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:54.872915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 11:59:54.875675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 11:59:54.879001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 11:59:54.879001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 11:59:54.879001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:59:54.879001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:59:54.879001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 11:59:54.879001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:54.880125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9a0d-f5a6-4fc1-a65f-d16d65d21c82 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:54.880824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 493/970] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 11:59:54 2022] POST /identity/v3/users => generated 160 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:54.880824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:54.891766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:54.899654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8f84-e671-4a07-a7cc-fc5a5cf92168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:54.899654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8f84-e671-4a07-a7cc-fc5a5cf92168 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:54.899654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8f84-e671-4a07-a7cc-fc5a5cf92168 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:54.899654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8f84-e671-4a07-a7cc-fc5a5cf92168 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:54.903801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a8f84-e671-4a07-a7cc-fc5a5cf92168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:54.903801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a8f84-e671-4a07-a7cc-fc5a5cf92168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:54.903801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a8f84-e671-4a07-a7cc-fc5a5cf92168 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:54.914678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 478/971] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:54.914678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8f84-e671-4a07-a7cc-fc5a5cf92168 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:54.983197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac30e12-102e-4f86-b51a-20bd52153c67 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.014048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:55.020981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3025d-b1c6-4bc1-b5ab-e275641b82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.021831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3025d-b1c6-4bc1-b5ab-e275641b82f8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.022065 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3025d-b1c6-4bc1-b5ab-e275641b82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.022334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3025d-b1c6-4bc1-b5ab-e275641b82f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.028778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3025d-b1c6-4bc1-b5ab-e275641b82f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.028905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8f84-e671-4a07-a7cc-fc5a5cf92168 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.029002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3025d-b1c6-4bc1-b5ab-e275641b82f8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-f0e3025d-b1c6-4bc1-b5ab-e275641b82f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:55.035470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:55.036724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:55.037752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:55.043986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 494/972] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:55.044913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3025d-b1c6-4bc1-b5ab-e275641b82f8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:55.065557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58a85-561f-4c37-9231-c498f097be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.066276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58a85-561f-4c37-9231-c498f097be4e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.066618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58a85-561f-4c37-9231-c498f097be4e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.066953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58a85-561f-4c37-9231-c498f097be4e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.075354 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d58a85-561f-4c37-9231-c498f097be4e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.077031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d58a85-561f-4c37-9231-c498f097be4e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-85d58a85-561f-4c37-9231-c498f097be4e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:55.090493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:55.091773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:55.093311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 479/973] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 11:59:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:55.096811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58a85-561f-4c37-9231-c498f097be4e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:55.151771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:55.176665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3025d-b1c6-4bc1-b5ab-e275641b82f8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.206111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58a85-561f-4c37-9231-c498f097be4e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.211740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367931df-6ad3-4288-8e3b-3b4299a62f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.212389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367931df-6ad3-4288-8e3b-3b4299a62f55 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.212676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367931df-6ad3-4288-8e3b-3b4299a62f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.213504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367931df-6ad3-4288-8e3b-3b4299a62f55 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.224076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367931df-6ad3-4288-8e3b-3b4299a62f55 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.225841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367931df-6ad3-4288-8e3b-3b4299a62f55 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-367931df-6ad3-4288-8e3b-3b4299a62f55 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:59:55.238544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:55.240572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 495/974] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 11:59:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:55.242598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367931df-6ad3-4288-8e3b-3b4299a62f55 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:55.245078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d2dbf-528a-4ef5-a2da-bf68918faf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.245780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d2dbf-528a-4ef5-a2da-bf68918faf6d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.246071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d2dbf-528a-4ef5-a2da-bf68918faf6d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.246349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d2dbf-528a-4ef5-a2da-bf68918faf6d None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.246985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d2dbf-528a-4ef5-a2da-bf68918faf6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:55.247319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d2dbf-528a-4ef5-a2da-bf68918faf6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.248695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d2dbf-528a-4ef5-a2da-bf68918faf6d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.254213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 480/975] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:55.255518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256d20-79e4-456d-bb95-cb96ff853bc4 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.256270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256d20-79e4-456d-bb95-cb96ff853bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.256270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256d20-79e4-456d-bb95-cb96ff853bc4 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.257397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 481/976] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:55.258092 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256d20-79e4-456d-bb95-cb96ff853bc4 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:55.303974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:55.348945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367931df-6ad3-4288-8e3b-3b4299a62f55 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.362172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256d20-79e4-456d-bb95-cb96ff853bc4 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.375553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:55.382282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d98351-48db-4eed-9167-be87e64f9bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.382896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d98351-48db-4eed-9167-be87e64f9bba None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.385343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d98351-48db-4eed-9167-be87e64f9bba None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.385343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d98351-48db-4eed-9167-be87e64f9bba None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.385343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d98351-48db-4eed-9167-be87e64f9bba None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:55.385343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d98351-48db-4eed-9167-be87e64f9bba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.386403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d98351-48db-4eed-9167-be87e64f9bba None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.396656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc46b05-e35e-469e-8d47-0fa676fe8354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.397340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc46b05-e35e-469e-8d47-0fa676fe8354 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.397624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc46b05-e35e-469e-8d47-0fa676fe8354 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.397898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc46b05-e35e-469e-8d47-0fa676fe8354 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.398624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc46b05-e35e-469e-8d47-0fa676fe8354 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:55.398930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc46b05-e35e-469e-8d47-0fa676fe8354 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.400404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc46b05-e35e-469e-8d47-0fa676fe8354 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.419544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 482/977] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 11:59:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:55.420467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc46b05-e35e-469e-8d47-0fa676fe8354 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:55.433540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 496/978] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 11:59:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:55.433540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cab89-769a-4160-8857-445ecac80280 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.433540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cab89-769a-4160-8857-445ecac80280 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.433540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cab89-769a-4160-8857-445ecac80280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.448814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-202cab89-769a-4160-8857-445ecac80280 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:55.450417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-202cab89-769a-4160-8857-445ecac80280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:55.539824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 497/979] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:55.541440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cab89-769a-4160-8857-445ecac80280 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:55.549385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc46b05-e35e-469e-8d47-0fa676fe8354 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.591455 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f95ff-5fb8-4d83-a233-674c709bd9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.592375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f95ff-5fb8-4d83-a233-674c709bd9cb None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.592836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f95ff-5fb8-4d83-a233-674c709bd9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.593267 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f95ff-5fb8-4d83-a233-674c709bd9cb None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.594068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f95ff-5fb8-4d83-a233-674c709bd9cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:55.594529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f95ff-5fb8-4d83-a233-674c709bd9cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.596116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f95ff-5fb8-4d83-a233-674c709bd9cb None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.604440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:55.606597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 483/980] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:55.607977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f95ff-5fb8-4d83-a233-674c709bd9cb None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:55.665192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:55.686907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cab89-769a-4160-8857-445ecac80280 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.729149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df23f4-da37-4f23-b12b-9f926123666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.729768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df23f4-da37-4f23-b12b-9f926123666e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.730048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df23f4-da37-4f23-b12b-9f926123666e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.730321 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df23f4-da37-4f23-b12b-9f926123666e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.744878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f95ff-5fb8-4d83-a233-674c709bd9cb None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.783783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b343-880c-4439-b7ca-c88ad67380bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.784800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b343-880c-4439-b7ca-c88ad67380bd None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.785128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b343-880c-4439-b7ca-c88ad67380bd None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.785410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b343-880c-4439-b7ca-c88ad67380bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.786168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b343-880c-4439-b7ca-c88ad67380bd None admin] RBAC: Adding query filter params (interface=admin, service_id=27550394c58046068ee24cbaa720f267, region_id=RegionOne) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:55.786490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b343-880c-4439-b7ca-c88ad67380bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.787894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b343-880c-4439-b7ca-c88ad67380bd None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.799305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 484/981] 10.222.0.27 () {56 vars in 1249 bytes} [Fri Sep 9 11:59:55 2022] GET /identity/v3/endpoints?service_id=27550394c58046068ee24cbaa720f267&interface=admin®ion_id=RegionOne => generated 193 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:55.801003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b343-880c-4439-b7ca-c88ad67380bd None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:55.813113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df23f4-da37-4f23-b12b-9f926123666e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.814891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df23f4-da37-4f23-b12b-9f926123666e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.856355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:55.898643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:55.901921 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b343-880c-4439-b7ca-c88ad67380bd None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:55.914371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 498/982] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 11:59:55 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:55.915195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df23f4-da37-4f23-b12b-9f926123666e None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:55.936215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b236-a462-40e4-8e15-8d65ad9347ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:55.936823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b236-a462-40e4-8e15-8d65ad9347ef None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:55.937155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b236-a462-40e4-8e15-8d65ad9347ef None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:55.937383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b236-a462-40e4-8e15-8d65ad9347ef None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:55.937997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073b236-a462-40e4-8e15-8d65ad9347ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:55.939362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073b236-a462-40e4-8e15-8d65ad9347ef None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:55.945839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 485/983] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 11:59:55 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:59:55.946617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b236-a462-40e4-8e15-8d65ad9347ef None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:56.030152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df23f4-da37-4f23-b12b-9f926123666e None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:56.062997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b236-a462-40e4-8e15-8d65ad9347ef None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:56.070133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f644-f5c0-408c-aaad-f8d29d9f2f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:56.070758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f644-f5c0-408c-aaad-f8d29d9f2f54 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:56.071046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f644-f5c0-408c-aaad-f8d29d9f2f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:56.071322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f644-f5c0-408c-aaad-f8d29d9f2f54 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:56.072029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5f644-f5c0-408c-aaad-f8d29d9f2f54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:56.074000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5f644-f5c0-408c-aaad-f8d29d9f2f54 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:56.101194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9eb72-dbc0-4eba-94c4-56cec598095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:56.101843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9eb72-dbc0-4eba-94c4-56cec598095b None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:56.102184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9eb72-dbc0-4eba-94c4-56cec598095b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:56.102472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9eb72-dbc0-4eba-94c4-56cec598095b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:56.117044 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9eb72-dbc0-4eba-94c4-56cec598095b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:56.118505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9eb72-dbc0-4eba-94c4-56cec598095b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-39f9eb72-dbc0-4eba-94c4-56cec598095b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:59:56.135653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:56.136782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:59:56.137713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:59:56.137713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:59:56.137713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:56.137713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 486/984] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:56.143826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9eb72-dbc0-4eba-94c4-56cec598095b None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:56.153574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 499/985] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 11:59:55 2022] POST /identity/v3/services => generated 242 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:56.164061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:56.260199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9eb72-dbc0-4eba-94c4-56cec598095b None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:56.306512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb4c4-ab12-492a-bf45-18131cba9171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:56.307825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb4c4-ab12-492a-bf45-18131cba9171 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:56.308178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb4c4-ab12-492a-bf45-18131cba9171 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:56.308520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb4c4-ab12-492a-bf45-18131cba9171 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:56.309253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbb4c4-ab12-492a-bf45-18131cba9171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:56.309627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbb4c4-ab12-492a-bf45-18131cba9171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:56.311084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbb4c4-ab12-492a-bf45-18131cba9171 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:56.324357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 487/986] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 11:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:56.329695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f644-f5c0-408c-aaad-f8d29d9f2f54 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:56.333760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:56.438252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f644-f5c0-408c-aaad-f8d29d9f2f54 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:56.475771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb84a1-214c-4aa5-8812-2584116b9859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:56.476616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb84a1-214c-4aa5-8812-2584116b9859 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:56.477001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb84a1-214c-4aa5-8812-2584116b9859 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:56.477401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb84a1-214c-4aa5-8812-2584116b9859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:56.485033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb84a1-214c-4aa5-8812-2584116b9859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:56.486664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb84a1-214c-4aa5-8812-2584116b9859 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-ffdb84a1-214c-4aa5-8812-2584116b9859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:59:56.498663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:56.499790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:56.500928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:59:56.500928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:59:56.500928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:59:56.500928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:59:56.500928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:59:56.500928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:59:56.500928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:59:56.500928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:56.502845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 500/987] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:56.508612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb4c4-ab12-492a-bf45-18131cba9171 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:56.581634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:56.616350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb4c4-ab12-492a-bf45-18131cba9171 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:56.651560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d76d5-2916-40e4-b259-8b21207aa1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:56.652209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d76d5-2916-40e4-b259-8b21207aa1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:56.652494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d76d5-2916-40e4-b259-8b21207aa1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:56.652771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d76d5-2916-40e4-b259-8b21207aa1c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:56.653452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d76d5-2916-40e4-b259-8b21207aa1c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:56.653761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d76d5-2916-40e4-b259-8b21207aa1c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:56.655232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d76d5-2916-40e4-b259-8b21207aa1c5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:56.669424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 488/988] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 11:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:56.674494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb84a1-214c-4aa5-8812-2584116b9859 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:56.737037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:56.777255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb84a1-214c-4aa5-8812-2584116b9859 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:56.811245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2787be-4a30-4166-b628-caf7d16e0932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:56.811971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2787be-4a30-4166-b628-caf7d16e0932 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:56.812325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2787be-4a30-4166-b628-caf7d16e0932 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:56.812673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2787be-4a30-4166-b628-caf7d16e0932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:56.813468 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2787be-4a30-4166-b628-caf7d16e0932 None admin] RBAC: Adding query filter params (role.id=6e4e3079bb5443eeabfe7d1c2cdb45f4, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=18bd4f37058e4019a1e5f13dfdcdc4ac) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:56.813855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2787be-4a30-4166-b628-caf7d16e0932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:56.815344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2787be-4a30-4166-b628-caf7d16e0932 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:56.827517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 501/989] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 11:59:56 2022] GET /identity/v3/role_assignments?user.id=18bd4f37058e4019a1e5f13dfdcdc4ac&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=6e4e3079bb5443eeabfe7d1c2cdb45f4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:58.252493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe846fe-1183-45bc-9a67-2e1de68c34ab None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:58.253029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe846fe-1183-45bc-9a67-2e1de68c34ab None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:58.253029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe846fe-1183-45bc-9a67-2e1de68c34ab None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:58.254601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 489/990] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:58.261083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde2ec-230b-4dd5-a24f-8904d544bb9b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:58.261647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde2ec-230b-4dd5-a24f-8904d544bb9b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:58.261647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde2ec-230b-4dd5-a24f-8904d544bb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:58.281006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4adde2ec-230b-4dd5-a24f-8904d544bb9b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:58.282233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4adde2ec-230b-4dd5-a24f-8904d544bb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:58.350953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 502/991] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:58.380512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb055-db87-46a2-9788-ac81414da258 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:58.380681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb055-db87-46a2-9788-ac81414da258 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:58.380926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb055-db87-46a2-9788-ac81414da258 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:58.382392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 490/992] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:58.388123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888265c-c876-48b7-aa74-194dea006528 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:58.388416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888265c-c876-48b7-aa74-194dea006528 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:58.388694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888265c-c876-48b7-aa74-194dea006528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:58.406673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d888265c-c876-48b7-aa74-194dea006528 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:58.410718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d888265c-c876-48b7-aa74-194dea006528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:58.465046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:58.482811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 503/993] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:58.620616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fb055-db87-46a2-9788-ac81414da258 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:58.721930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fb055-db87-46a2-9788-ac81414da258 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:58.749892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888265c-c876-48b7-aa74-194dea006528 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:58.751751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:58.758469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a61aba-7452-44bd-a162-4d86bbdb9f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:58.759123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a61aba-7452-44bd-a162-4d86bbdb9f08 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:58.759407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a61aba-7452-44bd-a162-4d86bbdb9f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:58.759710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a61aba-7452-44bd-a162-4d86bbdb9f08 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:58.760699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a61aba-7452-44bd-a162-4d86bbdb9f08 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:58.762420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a61aba-7452-44bd-a162-4d86bbdb9f08 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-84a61aba-7452-44bd-a162-4d86bbdb9f08 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:58.771537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:58.772781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:59:58.773862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:58.776159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 491/994] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 11:59:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:59:58.779066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a61aba-7452-44bd-a162-4d86bbdb9f08 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:58.860982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888265c-c876-48b7-aa74-194dea006528 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:58.878930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a61aba-7452-44bd-a162-4d86bbdb9f08 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:58.899607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb75bc-c5f8-4dc4-9010-4c62c56d15ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:58.900382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb75bc-c5f8-4dc4-9010-4c62c56d15ce None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:58.901196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb75bc-c5f8-4dc4-9010-4c62c56d15ce None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:58.901472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb75bc-c5f8-4dc4-9010-4c62c56d15ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:58.902056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb75bc-c5f8-4dc4-9010-4c62c56d15ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:58.903533 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb75bc-c5f8-4dc4-9010-4c62c56d15ce None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-fccb75bc-c5f8-4dc4-9010-4c62c56d15ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:58.913140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:58.914223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 11:59:58.916053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 504/995] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 11:59:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:58.918420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1221423-aed9-4cdd-a9bd-fc323981b74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:58.919057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1221423-aed9-4cdd-a9bd-fc323981b74e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:58.919336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1221423-aed9-4cdd-a9bd-fc323981b74e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:58.919693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1221423-aed9-4cdd-a9bd-fc323981b74e None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:58.920369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1221423-aed9-4cdd-a9bd-fc323981b74e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:58.920674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1221423-aed9-4cdd-a9bd-fc323981b74e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:58.921102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb75bc-c5f8-4dc4-9010-4c62c56d15ce None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:58.922170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1221423-aed9-4cdd-a9bd-fc323981b74e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:58.932834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 492/996] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:58.935239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1221423-aed9-4cdd-a9bd-fc323981b74e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:58.980108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:58.999723 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:59.035135 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb75bc-c5f8-4dc4-9010-4c62c56d15ce None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:59.045599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1221423-aed9-4cdd-a9bd-fc323981b74e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:59.069794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e957dd-6925-4d88-9165-7b9f4ae403da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:59.070547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e957dd-6925-4d88-9165-7b9f4ae403da None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.070734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e957dd-6925-4d88-9165-7b9f4ae403da None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.071021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e957dd-6925-4d88-9165-7b9f4ae403da None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.071822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e957dd-6925-4d88-9165-7b9f4ae403da None admin] RBAC: Adding query filter params (name=compute) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:59.072134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e957dd-6925-4d88-9165-7b9f4ae403da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:59.073529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e957dd-6925-4d88-9165-7b9f4ae403da None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:59.078566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 505/997] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:59.079413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c85c8c-7ef1-429c-9ae5-80005b625059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:59.079744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db9bd4-30cd-4b6e-ad59-c80c4c45c8eb None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.080033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db9bd4-30cd-4b6e-ad59-c80c4c45c8eb None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.080128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c85c8c-7ef1-429c-9ae5-80005b625059 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.080311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db9bd4-30cd-4b6e-ad59-c80c4c45c8eb None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.080406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c85c8c-7ef1-429c-9ae5-80005b625059 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.080674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c85c8c-7ef1-429c-9ae5-80005b625059 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.081373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c85c8c-7ef1-429c-9ae5-80005b625059 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:59.081753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 506/998] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 11:59:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:59:59.081855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c85c8c-7ef1-429c-9ae5-80005b625059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:59.083326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c85c8c-7ef1-429c-9ae5-80005b625059 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:59.084490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db9bd4-30cd-4b6e-ad59-c80c4c45c8eb None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:59.089204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 493/999] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 11:59:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:59.090823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43633969-3ac1-482c-ae84-2b5a64b73adc None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.091031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43633969-3ac1-482c-ae84-2b5a64b73adc None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.091309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43633969-3ac1-482c-ae84-2b5a64b73adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.110347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-43633969-3ac1-482c-ae84-2b5a64b73adc None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:59:59.111903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-43633969-3ac1-482c-ae84-2b5a64b73adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:59:59.180238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 494/1000] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 11:59:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:59:59.181066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43633969-3ac1-482c-ae84-2b5a64b73adc None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:59.191053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db9bd4-30cd-4b6e-ad59-c80c4c45c8eb None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:59.205897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:59.226156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf4cc9-7fe9-4a14-ba70-8b53edb82f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:59.226771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf4cc9-7fe9-4a14-ba70-8b53edb82f22 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.227054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf4cc9-7fe9-4a14-ba70-8b53edb82f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.227329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf4cc9-7fe9-4a14-ba70-8b53edb82f22 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.227991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf4cc9-7fe9-4a14-ba70-8b53edb82f22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:59.228297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf4cc9-7fe9-4a14-ba70-8b53edb82f22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:59.229676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf4cc9-7fe9-4a14-ba70-8b53edb82f22 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:59.239685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 507/1001] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 11:59:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:59.240531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf4cc9-7fe9-4a14-ba70-8b53edb82f22 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:59.253312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:59.299921 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43633969-3ac1-482c-ae84-2b5a64b73adc None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:59.339808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bf995-e945-41ea-ae4f-a55d695018ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:59.340441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bf995-e945-41ea-ae4f-a55d695018ea None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.340726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bf995-e945-41ea-ae4f-a55d695018ea None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.341003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bf995-e945-41ea-ae4f-a55d695018ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.341660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bf995-e945-41ea-ae4f-a55d695018ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:59.343020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bf995-e945-41ea-ae4f-a55d695018ea None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:59.351700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf4cc9-7fe9-4a14-ba70-8b53edb82f22 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:59.384604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4363-bed7-41cb-8232-bdf7820137b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:59.385720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4363-bed7-41cb-8232-bdf7820137b4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.386000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4363-bed7-41cb-8232-bdf7820137b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.386271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4363-bed7-41cb-8232-bdf7820137b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.386961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e4363-bed7-41cb-8232-bdf7820137b4 None admin] RBAC: Adding query filter params (interface=public, service_id=3d3783470f9c4caf9985b540964888ae, region_id=RegionOne) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:59.387272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e4363-bed7-41cb-8232-bdf7820137b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:59.389772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e4363-bed7-41cb-8232-bdf7820137b4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:59.395372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 508/1002] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 11:59:59 2022] GET /identity/v3/endpoints?service_id=3d3783470f9c4caf9985b540964888ae&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:59:59.401963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4363-bed7-41cb-8232-bdf7820137b4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:59.430217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 495/1003] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 11:59:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:59:59.448342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:59.454180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bf995-e945-41ea-ae4f-a55d695018ea None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:59.523331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4363-bed7-41cb-8232-bdf7820137b4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:59.578146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9297c32-0352-4b63-89a5-5ffdaf455d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:59.578772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9297c32-0352-4b63-89a5-5ffdaf455d4c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.579059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9297c32-0352-4b63-89a5-5ffdaf455d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.579336 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9297c32-0352-4b63-89a5-5ffdaf455d4c None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.579966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bf995-e945-41ea-ae4f-a55d695018ea None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:59.580075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9297c32-0352-4b63-89a5-5ffdaf455d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:59.581395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9297c32-0352-4b63-89a5-5ffdaf455d4c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:59.589051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 509/1004] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 11:59:59 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:59:59.595415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:59.628935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c5cb2-bd8d-4cb8-9176-d11e5840dafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:59.629993 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c5cb2-bd8d-4cb8-9176-d11e5840dafd None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.629993 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c5cb2-bd8d-4cb8-9176-d11e5840dafd None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.630170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c5cb2-bd8d-4cb8-9176-d11e5840dafd None admin] PATH_INFO: `/v3/services/image` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.630743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c5cb2-bd8d-4cb8-9176-d11e5840dafd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:59.632295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c5cb2-bd8d-4cb8-9176-d11e5840dafd None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-bc9c5cb2-bd8d-4cb8-9176-d11e5840dafd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:59:59.643288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:59:59.644422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 11:59:59.645281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 496/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Sep 9 11:59:59 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:59:59.651208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9297c32-0352-4b63-89a5-5ffdaf455d4c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:59.800042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9297c32-0352-4b63-89a5-5ffdaf455d4c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:59.801619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:59.841939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea7aeb-5960-4194-bcc0-7922d97240fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:59:59.842607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7aeb-5960-4194-bcc0-7922d97240fa None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:59:59.842896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7aeb-5960-4194-bcc0-7922d97240fa None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:59:59.843202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7aeb-5960-4194-bcc0-7922d97240fa None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:59:59.843876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea7aeb-5960-4194-bcc0-7922d97240fa None admin] RBAC: Adding query filter params (name=image) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:59:59.844186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea7aeb-5960-4194-bcc0-7922d97240fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:59:59.845556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea7aeb-5960-4194-bcc0-7922d97240fa None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:59:59.850900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 510/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:59:59.856718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c5cb2-bd8d-4cb8-9176-d11e5840dafd None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:59:59.962151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c5cb2-bd8d-4cb8-9176-d11e5840dafd None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:59:59.999860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f1ee9-d53d-4694-9cae-7bc765dfb05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:00.000492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f1ee9-d53d-4694-9cae-7bc765dfb05c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:00.000771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f1ee9-d53d-4694-9cae-7bc765dfb05c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:00.001040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f1ee9-d53d-4694-9cae-7bc765dfb05c None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:00.001668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f1ee9-d53d-4694-9cae-7bc765dfb05c None admin] RBAC: Adding query filter params (type=image) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:00.002239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f1ee9-d53d-4694-9cae-7bc765dfb05c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:00.003584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f1ee9-d53d-4694-9cae-7bc765dfb05c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:00.008666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 497/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 11:59:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:01.683408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb480f5-443c-40a5-98c6-0c443c13e51e None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:01.684055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb480f5-443c-40a5-98c6-0c443c13e51e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:01.684055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb480f5-443c-40a5-98c6-0c443c13e51e None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:01.687813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 511/1008] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:01.691438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76488f8-f019-4127-8ded-927d952436dc None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:01.691977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76488f8-f019-4127-8ded-927d952436dc None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:01.692171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76488f8-f019-4127-8ded-927d952436dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:01.712205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f76488f8-f019-4127-8ded-927d952436dc None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:01.713437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f76488f8-f019-4127-8ded-927d952436dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:01.744291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:01.783775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 498/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:01.808126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a39fa-a2d1-40e2-a4f0-b13ed740812d None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:01.808474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a39fa-a2d1-40e2-a4f0-b13ed740812d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:01.808683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a39fa-a2d1-40e2-a4f0-b13ed740812d None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:01.810145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 512/1010] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:01.815349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a96e4-ebe6-4f29-8ee8-4781d059f127 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:01.815666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a96e4-ebe6-4f29-8ee8-4781d059f127 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:01.815955 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a96e4-ebe6-4f29-8ee8-4781d059f127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:01.833852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8a0a96e4-ebe6-4f29-8ee8-4781d059f127 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:01.835027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8a0a96e4-ebe6-4f29-8ee8-4781d059f127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:01.906841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 499/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:02.055960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a39fa-a2d1-40e2-a4f0-b13ed740812d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:02.172530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a39fa-a2d1-40e2-a4f0-b13ed740812d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:02.177870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a96e4-ebe6-4f29-8ee8-4781d059f127 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:02.208745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305c7b7-eac3-4f49-8948-36b2d3b82783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:02.209373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305c7b7-eac3-4f49-8948-36b2d3b82783 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:02.209656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305c7b7-eac3-4f49-8948-36b2d3b82783 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:02.209931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305c7b7-eac3-4f49-8948-36b2d3b82783 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:02.211031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305c7b7-eac3-4f49-8948-36b2d3b82783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:02.212550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305c7b7-eac3-4f49-8948-36b2d3b82783 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:02.214722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 513/1012] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:02.215870 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1c03-701b-4217-9dd1-4e84d19be200 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:02.216157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1c03-701b-4217-9dd1-4e84d19be200 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:02.216433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1c03-701b-4217-9dd1-4e84d19be200 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:02.217752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 514/1013] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:02.220333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a1c03-701b-4217-9dd1-4e84d19be200 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:02.254828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:02.272922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:02.277469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a96e4-ebe6-4f29-8ee8-4781d059f127 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:02.311441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ac87c-92d9-4f02-adaf-d073b91e18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:02.312024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac87c-92d9-4f02-adaf-d073b91e18c0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:02.312629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac87c-92d9-4f02-adaf-d073b91e18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:02.313128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac87c-92d9-4f02-adaf-d073b91e18c0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:02.314183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ac87c-92d9-4f02-adaf-d073b91e18c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:02.315544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ac87c-92d9-4f02-adaf-d073b91e18c0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:02.320647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a1c03-701b-4217-9dd1-4e84d19be200 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-278ac87c-92d9-4f02-adaf-d073b91e18c0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:02.325694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:02.326881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:02.327842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 500/1014] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:00:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:02.328663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8766d7-afc1-457d-beeb-cb829264144f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:02.328663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8766d7-afc1-457d-beeb-cb829264144f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:02.328663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8766d7-afc1-457d-beeb-cb829264144f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:02.346853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-bd8766d7-afc1-457d-beeb-cb829264144f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:02.348066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bd8766d7-afc1-457d-beeb-cb829264144f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:02.358292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c78da-28eb-4fd6-b62d-929f95fe0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:02.358901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c78da-28eb-4fd6-b62d-929f95fe0053 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:02.359182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c78da-28eb-4fd6-b62d-929f95fe0053 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:02.359460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c78da-28eb-4fd6-b62d-929f95fe0053 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:02.360136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c78da-28eb-4fd6-b62d-929f95fe0053 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:02.361545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c78da-28eb-4fd6-b62d-929f95fe0053 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:02.414142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 501/1015] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:02.414984 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8766d7-afc1-457d-beeb-cb829264144f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:02.433779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 515/1016] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 12:00:02 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:00:02.524067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:02.535010 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8766d7-afc1-457d-beeb-cb829264144f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:02.573901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c305f-014a-4d8f-b101-c34fa6b8979a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:02.574692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c305f-014a-4d8f-b101-c34fa6b8979a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:02.575082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c305f-014a-4d8f-b101-c34fa6b8979a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:02.575457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c305f-014a-4d8f-b101-c34fa6b8979a None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:02.576249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c305f-014a-4d8f-b101-c34fa6b8979a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:02.576665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c305f-014a-4d8f-b101-c34fa6b8979a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:02.578177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c305f-014a-4d8f-b101-c34fa6b8979a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:02.587756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 502/1017] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 12:00:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:02.590384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c78da-28eb-4fd6-b62d-929f95fe0053 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:02.683106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:02.684229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c305f-014a-4d8f-b101-c34fa6b8979a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:02.702363 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c78da-28eb-4fd6-b62d-929f95fe0053 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:02.741069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2390796-9eec-4536-88a9-6e0bc28341cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:02.742154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2390796-9eec-4536-88a9-6e0bc28341cd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:02.742433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2390796-9eec-4536-88a9-6e0bc28341cd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:02.742706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2390796-9eec-4536-88a9-6e0bc28341cd None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:02.743365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2390796-9eec-4536-88a9-6e0bc28341cd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:02.743710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2390796-9eec-4536-88a9-6e0bc28341cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:02.745592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2390796-9eec-4536-88a9-6e0bc28341cd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:02.755115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 516/1018] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 12:00:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:02.756417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2390796-9eec-4536-88a9-6e0bc28341cd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:02.798508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c305f-014a-4d8f-b101-c34fa6b8979a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:02.838236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e6439-b3c3-414e-9856-981c82caddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:02.838760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6439-b3c3-414e-9856-981c82caddbe None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:02.839039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6439-b3c3-414e-9856-981c82caddbe None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:02.839308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6439-b3c3-414e-9856-981c82caddbe None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:02.839990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6439-b3c3-414e-9856-981c82caddbe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:02.841373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6439-b3c3-414e-9856-981c82caddbe None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:02.863285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2390796-9eec-4536-88a9-6e0bc28341cd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:02.897484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38b76f-a7c6-4ca2-aa6d-34f71cc54f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:02.898091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b76f-a7c6-4ca2-aa6d-34f71cc54f62 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:02.898374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b76f-a7c6-4ca2-aa6d-34f71cc54f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:02.898664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b76f-a7c6-4ca2-aa6d-34f71cc54f62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:02.899305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38b76f-a7c6-4ca2-aa6d-34f71cc54f62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:02.900722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38b76f-a7c6-4ca2-aa6d-34f71cc54f62 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:02.955501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 503/1019] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 12:00:02 2022] POST /identity/v3/services => generated 242 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:00:02.985960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 517/1020] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:00:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:00:04.693571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d53945-7e5d-4ef4-a1b6-b15f6ea2b8af None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:04.694140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d53945-7e5d-4ef4-a1b6-b15f6ea2b8af None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:04.694140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d53945-7e5d-4ef4-a1b6-b15f6ea2b8af None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:04.698598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 504/1021] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:04.701509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8b78e-77c9-482d-9165-fb3e0423dab7 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:04.701940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8b78e-77c9-482d-9165-fb3e0423dab7 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:04.702105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8b78e-77c9-482d-9165-fb3e0423dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:04.715118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:04.720885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ebe8b78e-77c9-482d-9165-fb3e0423dab7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:04.722084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ebe8b78e-77c9-482d-9165-fb3e0423dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:04.802474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 518/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 12:00:05.069577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d53945-7e5d-4ef4-a1b6-b15f6ea2b8af None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:05.089861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:05.174778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e2461-19da-423a-8f70-4992b4b31d42 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:05.175148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e2461-19da-423a-8f70-4992b4b31d42 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:05.175339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e2461-19da-423a-8f70-4992b4b31d42 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:05.176932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 519/1023] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:05.182420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c8ea-fd7d-4c7b-a9b0-65f61a682973 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:05.182704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c8ea-fd7d-4c7b-a9b0-65f61a682973 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:05.182984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c8ea-fd7d-4c7b-a9b0-65f61a682973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:05.192184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d53945-7e5d-4ef4-a1b6-b15f6ea2b8af None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:05.202277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d230c8ea-fd7d-4c7b-a9b0-65f61a682973 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:05.203552 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d230c8ea-fd7d-4c7b-a9b0-65f61a682973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:05.233684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17560c-2790-4105-a32d-750986006912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:05.234599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17560c-2790-4105-a32d-750986006912 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:05.235030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17560c-2790-4105-a32d-750986006912 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:05.235440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17560c-2790-4105-a32d-750986006912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:05.236840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17560c-2790-4105-a32d-750986006912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:05.238343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17560c-2790-4105-a32d-750986006912 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:05.243667 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 505/1024] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:05.245647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17560c-2790-4105-a32d-750986006912 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:05.284212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 520/1025] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 12:00:05.288985 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7567ea0-5b99-48e3-b8d5-3f02a076f3dc None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:05.289336 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7567ea0-5b99-48e3-b8d5-3f02a076f3dc None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:05.290039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7567ea0-5b99-48e3-b8d5-3f02a076f3dc None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:05.292038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 521/1026] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:05.297373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a1bb-2e47-4707-9a62-386a45b00858 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:05.297618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a1bb-2e47-4707-9a62-386a45b00858 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:05.298280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a1bb-2e47-4707-9a62-386a45b00858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:05.317677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-7657a1bb-2e47-4707-9a62-386a45b00858 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:05.318853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7657a1bb-2e47-4707-9a62-386a45b00858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:05.337587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:05.357775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17560c-2790-4105-a32d-750986006912 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:05.384046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:05.394846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 522/1027] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 12:00:05.395280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244dc26-07d7-4a03-b34d-123973bb90c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:05.395916 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244dc26-07d7-4a03-b34d-123973bb90c5 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:05.396199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244dc26-07d7-4a03-b34d-123973bb90c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:05.396470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244dc26-07d7-4a03-b34d-123973bb90c5 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:05.397134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244dc26-07d7-4a03-b34d-123973bb90c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:05.398554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244dc26-07d7-4a03-b34d-123973bb90c5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:05.524778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 506/1028] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 12:00:05 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:00:05.558392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a1bb-2e47-4707-9a62-386a45b00858 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:05.669682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244dc26-07d7-4a03-b34d-123973bb90c5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:05.670931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a1bb-2e47-4707-9a62-386a45b00858 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:05.709724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08d933-5590-4b20-892a-2ffdf5521865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:05.710390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08d933-5590-4b20-892a-2ffdf5521865 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:05.711214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08d933-5590-4b20-892a-2ffdf5521865 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:05.711214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08d933-5590-4b20-892a-2ffdf5521865 None admin] PATH_INFO: `/v3/services/image` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:05.711472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08d933-5590-4b20-892a-2ffdf5521865 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:05.712933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08d933-5590-4b20-892a-2ffdf5521865 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-df08d933-5590-4b20-892a-2ffdf5521865 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:05.722437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:05.723490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:05.724432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 523/1029] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Sep 9 12:00:05 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:05.731192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08d933-5590-4b20-892a-2ffdf5521865 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:05.794415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244dc26-07d7-4a03-b34d-123973bb90c5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:05.799532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:05.837138 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f6ef4-2ae7-4f58-a77b-204eb8c08da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:05.837930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f6ef4-2ae7-4f58-a77b-204eb8c08da8 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:05.838214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f6ef4-2ae7-4f58-a77b-204eb8c08da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:05.839013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f6ef4-2ae7-4f58-a77b-204eb8c08da8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:05.844704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08d933-5590-4b20-892a-2ffdf5521865 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:05.847231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:05.850827 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f6ef4-2ae7-4f58-a77b-204eb8c08da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-0c0f6ef4-2ae7-4f58-a77b-204eb8c08da8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:00:05.856405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:05.857551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 12:00:05.858574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:05.860933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 507/1030] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 12:00:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:05.866712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f6ef4-2ae7-4f58-a77b-204eb8c08da8 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:05.884361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190a62-37a6-4ab4-a83e-2201d568c1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:05.884984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190a62-37a6-4ab4-a83e-2201d568c1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:05.885804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190a62-37a6-4ab4-a83e-2201d568c1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:05.886082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190a62-37a6-4ab4-a83e-2201d568c1b2 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:05.886906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32190a62-37a6-4ab4-a83e-2201d568c1b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:05.887220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32190a62-37a6-4ab4-a83e-2201d568c1b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:05.889216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32190a62-37a6-4ab4-a83e-2201d568c1b2 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:05.899685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 524/1031] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:05.900765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190a62-37a6-4ab4-a83e-2201d568c1b2 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:05.983440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f6ef4-2ae7-4f58-a77b-204eb8c08da8 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:06.010732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190a62-37a6-4ab4-a83e-2201d568c1b2 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:06.020293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42334ce8-119b-4b9b-b087-8272a425b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:06.021234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42334ce8-119b-4b9b-b087-8272a425b982 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:06.021515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42334ce8-119b-4b9b-b087-8272a425b982 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:06.021850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42334ce8-119b-4b9b-b087-8272a425b982 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:06.022605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42334ce8-119b-4b9b-b087-8272a425b982 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:06.022918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42334ce8-119b-4b9b-b087-8272a425b982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:06.024317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42334ce8-119b-4b9b-b087-8272a425b982 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:06.032455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:06.033203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 508/1032] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 12:00:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:06.038780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42334ce8-119b-4b9b-b087-8272a425b982 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:06.047849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55457a-7a60-42f0-8f70-f6525f77a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:06.048467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55457a-7a60-42f0-8f70-f6525f77a504 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:06.048746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55457a-7a60-42f0-8f70-f6525f77a504 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:06.049018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55457a-7a60-42f0-8f70-f6525f77a504 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:06.049643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55457a-7a60-42f0-8f70-f6525f77a504 None admin] RBAC: Adding query filter params (type=image) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:06.049944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55457a-7a60-42f0-8f70-f6525f77a504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:06.051361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55457a-7a60-42f0-8f70-f6525f77a504 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:06.056771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 525/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:06.063213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55457a-7a60-42f0-8f70-f6525f77a504 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:06.107327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:06.152017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42334ce8-119b-4b9b-b087-8272a425b982 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:06.180763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55457a-7a60-42f0-8f70-f6525f77a504 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:06.190380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6044a75-babb-42bd-af85-2f7d8088b529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:06.191017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6044a75-babb-42bd-af85-2f7d8088b529 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:06.191298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6044a75-babb-42bd-af85-2f7d8088b529 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:06.191578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6044a75-babb-42bd-af85-2f7d8088b529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:06.202937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6044a75-babb-42bd-af85-2f7d8088b529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:06.204577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6044a75-babb-42bd-af85-2f7d8088b529 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:06.215577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd474-d13f-4e44-882d-c8134f45e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:06.216202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd474-d13f-4e44-882d-c8134f45e3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:06.216481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd474-d13f-4e44-882d-c8134f45e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:06.216752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd474-d13f-4e44-882d-c8134f45e3e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:06.217439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dd474-d13f-4e44-882d-c8134f45e3e4 None admin] RBAC: Adding query filter params (interface=public, service_id=ff733a3ed9884178b866ee0e610f7083, region_id=RegionOne) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:06.217745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dd474-d13f-4e44-882d-c8134f45e3e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-f6044a75-babb-42bd-af85-2f7d8088b529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:00:06.218869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:06.224820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:00:06.225832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:00:06.225832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:06.225832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:06.226010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dd474-d13f-4e44-882d-c8134f45e3e4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:06.226082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 509/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:06.226082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6044a75-babb-42bd-af85-2f7d8088b529 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:06.231398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 526/1035] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 12:00:06 2022] GET /identity/v3/endpoints?service_id=ff733a3ed9884178b866ee0e610f7083&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:06.237433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd474-d13f-4e44-882d-c8134f45e3e4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:06.288522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:06.332594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6044a75-babb-42bd-af85-2f7d8088b529 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:06.343728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd474-d13f-4e44-882d-c8134f45e3e4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:06.347749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:06.369164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec249a5-9c24-4858-8384-4911f48e7fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:06.369905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec249a5-9c24-4858-8384-4911f48e7fbe None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:06.370185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec249a5-9c24-4858-8384-4911f48e7fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:06.370465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec249a5-9c24-4858-8384-4911f48e7fbe None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:06.371150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec249a5-9c24-4858-8384-4911f48e7fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:06.371454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec249a5-9c24-4858-8384-4911f48e7fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:06.373078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec249a5-9c24-4858-8384-4911f48e7fbe None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:06.377672 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e65a1a-b0cf-42b1-bab1-5a0dd5ceb511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:06.378281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e65a1a-b0cf-42b1-bab1-5a0dd5ceb511 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:06.378565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e65a1a-b0cf-42b1-bab1-5a0dd5ceb511 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:06.378832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e65a1a-b0cf-42b1-bab1-5a0dd5ceb511 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:06.379427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e65a1a-b0cf-42b1-bab1-5a0dd5ceb511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:06.380810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e65a1a-b0cf-42b1-bab1-5a0dd5ceb511 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:06.390533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 510/1036] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:06.390743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 527/1037] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 12:00:06 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:00:06.393074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec249a5-9c24-4858-8384-4911f48e7fbe None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:06.506419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec249a5-9c24-4858-8384-4911f48e7fbe None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:06.544004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4783973-7150-4945-b157-6cf4829fa494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:06.544646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783973-7150-4945-b157-6cf4829fa494 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:06.544922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783973-7150-4945-b157-6cf4829fa494 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:06.545191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783973-7150-4945-b157-6cf4829fa494 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:06.553978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4783973-7150-4945-b157-6cf4829fa494 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:06.555432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4783973-7150-4945-b157-6cf4829fa494 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-f4783973-7150-4945-b157-6cf4829fa494 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 12:00:06.567764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:06.568808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:06.572602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 511/1038] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 12:00:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:06.574860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e65a1a-b0cf-42b1-bab1-5a0dd5ceb511 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:06.680035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e65a1a-b0cf-42b1-bab1-5a0dd5ceb511 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:06.692583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:06.714883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec14d0b-5fab-4087-b402-49c3b2d34036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:06.715497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec14d0b-5fab-4087-b402-49c3b2d34036 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:06.715781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec14d0b-5fab-4087-b402-49c3b2d34036 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:06.716052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec14d0b-5fab-4087-b402-49c3b2d34036 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:06.716774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec14d0b-5fab-4087-b402-49c3b2d34036 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:06.717125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec14d0b-5fab-4087-b402-49c3b2d34036 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:06.718526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec14d0b-5fab-4087-b402-49c3b2d34036 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:06.736967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 528/1039] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 12:00:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:06.742934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4783973-7150-4945-b157-6cf4829fa494 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:06.778332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:06.844381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4783973-7150-4945-b157-6cf4829fa494 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:06.878180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bfdde-a4db-47f2-bd10-ca9f271de801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:06.878785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bfdde-a4db-47f2-bd10-ca9f271de801 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:06.879063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bfdde-a4db-47f2-bd10-ca9f271de801 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:06.879335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bfdde-a4db-47f2-bd10-ca9f271de801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:06.946573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bfdde-a4db-47f2-bd10-ca9f271de801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:06.948614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bfdde-a4db-47f2-bd10-ca9f271de801 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:06.982087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:07.053684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 512/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:06 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:07.055383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec14d0b-5fab-4087-b402-49c3b2d34036 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:07.187709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec14d0b-5fab-4087-b402-49c3b2d34036 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:07.224249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc042e90-4a58-4cdb-8237-a18c5a401a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:07.224880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc042e90-4a58-4cdb-8237-a18c5a401a83 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:07.225157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc042e90-4a58-4cdb-8237-a18c5a401a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:07.225437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc042e90-4a58-4cdb-8237-a18c5a401a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:07.237632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc042e90-4a58-4cdb-8237-a18c5a401a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:07.239072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc042e90-4a58-4cdb-8237-a18c5a401a83 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-dc042e90-4a58-4cdb-8237-a18c5a401a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:00:07.255049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:07.256154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:00:07.257722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:00:07.257722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:07.257722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:07.263531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 529/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:07.264792 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bfdde-a4db-47f2-bd10-ca9f271de801 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:07.392422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bfdde-a4db-47f2-bd10-ca9f271de801 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:07.440272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db935b-ec11-455d-addc-ffa8c3c84f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:07.441917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db935b-ec11-455d-addc-ffa8c3c84f84 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:07.442195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db935b-ec11-455d-addc-ffa8c3c84f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:07.442532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db935b-ec11-455d-addc-ffa8c3c84f84 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:07.443188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db935b-ec11-455d-addc-ffa8c3c84f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:07.446965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db935b-ec11-455d-addc-ffa8c3c84f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:07.448426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db935b-ec11-455d-addc-ffa8c3c84f84 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:07.450134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:07.462739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 513/1042] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:07.469415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc042e90-4a58-4cdb-8237-a18c5a401a83 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:07.501992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:07.589254 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc042e90-4a58-4cdb-8237-a18c5a401a83 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:07.627161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511357a3-b614-4cad-9976-793986005c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:07.628090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511357a3-b614-4cad-9976-793986005c86 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:07.628379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511357a3-b614-4cad-9976-793986005c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:07.628653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511357a3-b614-4cad-9976-793986005c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:07.635966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511357a3-b614-4cad-9976-793986005c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:07.637417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511357a3-b614-4cad-9976-793986005c86 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-511357a3-b614-4cad-9976-793986005c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 12:00:07.656122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:07.657067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:07.663278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 12:00:07.663278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 12:00:07.663278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:00:07.663278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:00:07.663278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:00:07.663278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:00:07.663278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:00:07.663278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:07.663278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 530/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:07.665263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db935b-ec11-455d-addc-ffa8c3c84f84 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:07.786049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db935b-ec11-455d-addc-ffa8c3c84f84 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:07.829146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931eb73a-92d6-45de-9cbe-edb625fa16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:07.829775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eb73a-92d6-45de-9cbe-edb625fa16c4 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:07.830052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eb73a-92d6-45de-9cbe-edb625fa16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:07.830322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eb73a-92d6-45de-9cbe-edb625fa16c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:07.831012 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eb73a-92d6-45de-9cbe-edb625fa16c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:07.831328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eb73a-92d6-45de-9cbe-edb625fa16c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:07.832804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eb73a-92d6-45de-9cbe-edb625fa16c4 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:07.845483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 514/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 12:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:07.851421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511357a3-b614-4cad-9976-793986005c86 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:07.925991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed14f5f-a8b0-4a16-81e0-4c47f9d33223 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:07.926200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed14f5f-a8b0-4a16-81e0-4c47f9d33223 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:07.926478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed14f5f-a8b0-4a16-81e0-4c47f9d33223 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:07.927833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 515/1045] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:07.933000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6a99a-2dae-4f74-a033-da92fc5b0e0f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:07.933284 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6a99a-2dae-4f74-a033-da92fc5b0e0f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:07.933568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6a99a-2dae-4f74-a033-da92fc5b0e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:07.944322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:07.954296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-c0b6a99a-2dae-4f74-a033-da92fc5b0e0f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:07.955467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c0b6a99a-2dae-4f74-a033-da92fc5b0e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:07.963077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511357a3-b614-4cad-9976-793986005c86 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:08.003544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01f214-6f9d-4e42-950b-f3b2277c6a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:08.004339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01f214-6f9d-4e42-950b-f3b2277c6a97 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:08.004553 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01f214-6f9d-4e42-950b-f3b2277c6a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:08.004825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01f214-6f9d-4e42-950b-f3b2277c6a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:08.005548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01f214-6f9d-4e42-950b-f3b2277c6a97 None admin] RBAC: Adding query filter params (role.id=6e4e3079bb5443eeabfe7d1c2cdb45f4, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=4971acb91bbf498887606c5ba5d00176) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:08.005861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01f214-6f9d-4e42-950b-f3b2277c6a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:08.007271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01f214-6f9d-4e42-950b-f3b2277c6a97 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:08.014095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 531/1046] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:00:07 2022] GET /identity/v3/role_assignments?user.id=4971acb91bbf498887606c5ba5d00176&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=6e4e3079bb5443eeabfe7d1c2cdb45f4 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:08.015346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:08.035579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 516/1047] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 12:00:08.309037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01f214-6f9d-4e42-950b-f3b2277c6a97 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:08.413691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01f214-6f9d-4e42-950b-f3b2277c6a97 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:08.450936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef56b1-2f8e-4e9e-8773-add24a9356dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:08.451573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef56b1-2f8e-4e9e-8773-add24a9356dd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:08.451882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef56b1-2f8e-4e9e-8773-add24a9356dd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:08.452161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef56b1-2f8e-4e9e-8773-add24a9356dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:08.463367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef56b1-2f8e-4e9e-8773-add24a9356dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-1eef56b1-2f8e-4e9e-8773-add24a9356dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:00:08.468579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:08.469526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:08.470431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:08.473414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 532/1048] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:00:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:08.475841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6a99a-2dae-4f74-a033-da92fc5b0e0f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:08.583774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6a99a-2dae-4f74-a033-da92fc5b0e0f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:08.615719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072d06e-fabd-4d3d-9b53-46dc2a4ca0d5 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:08.616008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072d06e-fabd-4d3d-9b53-46dc2a4ca0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:08.616284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072d06e-fabd-4d3d-9b53-46dc2a4ca0d5 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:08.618431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 533/1049] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 12:00:08.620122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65179634-3f7f-4ed8-a202-a0ccd60cdb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:08.620599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179634-3f7f-4ed8-a202-a0ccd60cdb7f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:08.620882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179634-3f7f-4ed8-a202-a0ccd60cdb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:08.621158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179634-3f7f-4ed8-a202-a0ccd60cdb7f None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:08.621830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65179634-3f7f-4ed8-a202-a0ccd60cdb7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:08.622223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65179634-3f7f-4ed8-a202-a0ccd60cdb7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:08.623577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a20c7-bfd2-4c02-8536-4e431d06c267 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:08.623727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65179634-3f7f-4ed8-a202-a0ccd60cdb7f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:08.624195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a20c7-bfd2-4c02-8536-4e431d06c267 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:08.624640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a20c7-bfd2-4c02-8536-4e431d06c267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:08.635844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 517/1050] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:00:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:08.637308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:08.638181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65179634-3f7f-4ed8-a202-a0ccd60cdb7f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:08.643403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-760a20c7-bfd2-4c02-8536-4e431d06c267 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:08.644695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-760a20c7-bfd2-4c02-8536-4e431d06c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:08.685497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:08.719209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 534/1051] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:08.749077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65179634-3f7f-4ed8-a202-a0ccd60cdb7f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:08.782873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b84a9c-f972-431c-a0e9-2f253d8487ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:08.783507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b84a9c-f972-431c-a0e9-2f253d8487ea None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:08.783817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b84a9c-f972-431c-a0e9-2f253d8487ea None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:08.784097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b84a9c-f972-431c-a0e9-2f253d8487ea None admin] PATH_INFO: `/v3/users/f33270c96e494e73a88179ebedd42c0e` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:08.798020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b84a9c-f972-431c-a0e9-2f253d8487ea None admin] RBAC: Authorizing `identity:get_user(user_id=f33270c96e494e73a88179ebedd42c0e)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:08.799458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b84a9c-f972-431c-a0e9-2f253d8487ea None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:08.801322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 518/1052] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:08 2022] GET /identity/v3/users/f33270c96e494e73a88179ebedd42c0e => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:08.806853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a20c7-bfd2-4c02-8536-4e431d06c267 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:08.908590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a20c7-bfd2-4c02-8536-4e431d06c267 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:08.941608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822c5de-73d4-49dc-911a-f09fac90b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:08.942217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822c5de-73d4-49dc-911a-f09fac90b2aa None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:08.946251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822c5de-73d4-49dc-911a-f09fac90b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:08.946251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822c5de-73d4-49dc-911a-f09fac90b2aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:08.946551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:08.985053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b84a9c-f972-431c-a0e9-2f253d8487ea None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:09.019226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822c5de-73d4-49dc-911a-f09fac90b2aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:09.020704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822c5de-73d4-49dc-911a-f09fac90b2aa None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:09.094977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b84a9c-f972-431c-a0e9-2f253d8487ea None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:09.097464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:09.135895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcdecc-12c8-4817-86b9-77acb2eeaf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:09.136718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcdecc-12c8-4817-86b9-77acb2eeaf02 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:09.137223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcdecc-12c8-4817-86b9-77acb2eeaf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:09.138058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcdecc-12c8-4817-86b9-77acb2eeaf02 None admin] PATH_INFO: `/v3/services/image` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:09.138647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcdecc-12c8-4817-86b9-77acb2eeaf02 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:09.143737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 535/1053] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:09.143888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcdecc-12c8-4817-86b9-77acb2eeaf02 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:09.144977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822c5de-73d4-49dc-911a-f09fac90b2aa None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-0cbcdecc-12c8-4817-86b9-77acb2eeaf02 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:09.149519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:09.150563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:09.152184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 519/1054] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Sep 9 12:00:08 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:09.157842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcdecc-12c8-4817-86b9-77acb2eeaf02 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:09.186794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:09.254364 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822c5de-73d4-49dc-911a-f09fac90b2aa None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:09.263513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcdecc-12c8-4817-86b9-77acb2eeaf02 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:09.291912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa497ab5-17de-4c12-8c10-1d4c08d26c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:09.292544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa497ab5-17de-4c12-8c10-1d4c08d26c9d None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:09.292824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa497ab5-17de-4c12-8c10-1d4c08d26c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:09.293101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa497ab5-17de-4c12-8c10-1d4c08d26c9d None admin] PATH_INFO: `/v3/projects/e6aed93d25974ea189667140f8390776` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:09.294216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa497ab5-17de-4c12-8c10-1d4c08d26c9d None admin] RBAC: Authorizing `identity:get_project(project_id=e6aed93d25974ea189667140f8390776)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:09.295662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa497ab5-17de-4c12-8c10-1d4c08d26c9d None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:09.297301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 536/1055] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:00:09 2022] GET /identity/v3/projects/e6aed93d25974ea189667140f8390776 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:09.303163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b454f5-1b91-4bde-bf27-b97206168512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:09.303312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa497ab5-17de-4c12-8c10-1d4c08d26c9d None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:09.303811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b454f5-1b91-4bde-bf27-b97206168512 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:09.304097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b454f5-1b91-4bde-bf27-b97206168512 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:09.304373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b454f5-1b91-4bde-bf27-b97206168512 None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:09.305004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b454f5-1b91-4bde-bf27-b97206168512 None admin] RBAC: Adding query filter params (name=image) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:09.305309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b454f5-1b91-4bde-bf27-b97206168512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:09.306675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b454f5-1b91-4bde-bf27-b97206168512 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:09.312321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 520/1056] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:09.317808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b454f5-1b91-4bde-bf27-b97206168512 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:09.349332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:09.414898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa497ab5-17de-4c12-8c10-1d4c08d26c9d None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:09.418261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:09.421493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b454f5-1b91-4bde-bf27-b97206168512 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:09.451190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c787b2f-e9de-442b-a576-e5b53d79b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:09.451733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c787b2f-e9de-442b-a576-e5b53d79b486 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:09.452072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c787b2f-e9de-442b-a576-e5b53d79b486 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:09.452347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c787b2f-e9de-442b-a576-e5b53d79b486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:09.453090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c787b2f-e9de-442b-a576-e5b53d79b486 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=e6aed93d25974ea189667140f8390776, user.id=f33270c96e494e73a88179ebedd42c0e) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:09.453402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c787b2f-e9de-442b-a576-e5b53d79b486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:09.454814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c787b2f-e9de-442b-a576-e5b53d79b486 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:09.461998 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 537/1057] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:00:09 2022] GET /identity/v3/role_assignments?user.id=f33270c96e494e73a88179ebedd42c0e&scope.project.id=e6aed93d25974ea189667140f8390776&role.id=06592016669243d99b430c46dd1c1d46 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:09.470926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789a20a-044c-4103-a5cd-61910a124ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:09.471905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a20a-044c-4103-a5cd-61910a124ffd None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:09.472394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a20a-044c-4103-a5cd-61910a124ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:09.472856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a20a-044c-4103-a5cd-61910a124ffd None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:09.473690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789a20a-044c-4103-a5cd-61910a124ffd None admin] RBAC: Adding query filter params (type=image) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:09.474184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789a20a-044c-4103-a5cd-61910a124ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:09.475827 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789a20a-044c-4103-a5cd-61910a124ffd None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:09.482779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 521/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:09.488510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c787b2f-e9de-442b-a576-e5b53d79b486 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:09.598954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c787b2f-e9de-442b-a576-e5b53d79b486 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:09.636480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6a37-1de9-4b31-ba1e-67c65695e658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:09.636897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6a37-1de9-4b31-ba1e-67c65695e658 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:09.637801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6a37-1de9-4b31-ba1e-67c65695e658 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:09.637801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6a37-1de9-4b31-ba1e-67c65695e658 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:09.638108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6a37-1de9-4b31-ba1e-67c65695e658 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:09.640234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6a37-1de9-4b31-ba1e-67c65695e658 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:09.728121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 538/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:00:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:00:10.186107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f9e1f-b1be-4473-ac71-8443357e488b None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:10.186625 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f9e1f-b1be-4473-ac71-8443357e488b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:10.186704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f9e1f-b1be-4473-ac71-8443357e488b None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:10.188216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 522/1060] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:10.193300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d349a-2606-4ced-934d-db11c6ab2e20 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:10.193746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d349a-2606-4ced-934d-db11c6ab2e20 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:10.193951 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d349a-2606-4ced-934d-db11c6ab2e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:10.212339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-306d349a-2606-4ced-934d-db11c6ab2e20 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:10.214080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-306d349a-2606-4ced-934d-db11c6ab2e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:10.232480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:10.289186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 539/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:10.559586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f9e1f-b1be-4473-ac71-8443357e488b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:10.661700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:10.668989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f9e1f-b1be-4473-ac71-8443357e488b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:10.704349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bb85c-af08-4438-8b81-c45f9f1dc640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:10.704989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bb85c-af08-4438-8b81-c45f9f1dc640 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:10.705272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bb85c-af08-4438-8b81-c45f9f1dc640 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:10.705545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bb85c-af08-4438-8b81-c45f9f1dc640 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:10.716496 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bb85c-af08-4438-8b81-c45f9f1dc640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-ff2bb85c-af08-4438-8b81-c45f9f1dc640 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:00:10.721390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:10.722343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 12:00:10.723198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:10.724578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 523/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 12:00:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:10.728475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d349a-2606-4ced-934d-db11c6ab2e20 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:10.834291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d349a-2606-4ced-934d-db11c6ab2e20 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:10.869294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e845ee-703c-454c-a6c7-51572758f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:10.870439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e845ee-703c-454c-a6c7-51572758f629 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:10.870722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e845ee-703c-454c-a6c7-51572758f629 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:10.870995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e845ee-703c-454c-a6c7-51572758f629 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:10.871679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e845ee-703c-454c-a6c7-51572758f629 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:10.871986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e845ee-703c-454c-a6c7-51572758f629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:10.873346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e845ee-703c-454c-a6c7-51572758f629 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:10.883793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 540/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 12:00:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:10.888084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bb85c-af08-4438-8b81-c45f9f1dc640 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:10.990833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bb85c-af08-4438-8b81-c45f9f1dc640 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:11.026919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00382a4f-4dfb-40f3-a600-ed4a727371b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:11.027546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00382a4f-4dfb-40f3-a600-ed4a727371b0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.027860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00382a4f-4dfb-40f3-a600-ed4a727371b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.028133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00382a4f-4dfb-40f3-a600-ed4a727371b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.039133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00382a4f-4dfb-40f3-a600-ed4a727371b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:11.040608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00382a4f-4dfb-40f3-a600-ed4a727371b0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-00382a4f-4dfb-40f3-a600-ed4a727371b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:00:11.054760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:11.055783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:00:11.062436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:00:11.062436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:11.062436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:11.062436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 524/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:11.062669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e845ee-703c-454c-a6c7-51572758f629 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:11.078352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:11.184136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e845ee-703c-454c-a6c7-51572758f629 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:11.218391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3010c5e-7366-4fee-8ed2-a543c47f22bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:11.219020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3010c5e-7366-4fee-8ed2-a543c47f22bd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.219268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3010c5e-7366-4fee-8ed2-a543c47f22bd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.219542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3010c5e-7366-4fee-8ed2-a543c47f22bd None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.220212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3010c5e-7366-4fee-8ed2-a543c47f22bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:11.220516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3010c5e-7366-4fee-8ed2-a543c47f22bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:11.221858 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3010c5e-7366-4fee-8ed2-a543c47f22bd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:11.233967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 541/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:11.239336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00382a4f-4dfb-40f3-a600-ed4a727371b0 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:11.251400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:11.341164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00382a4f-4dfb-40f3-a600-ed4a727371b0 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:11.374833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f58b9-07bd-452b-baf2-a80d97596d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:11.375385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f58b9-07bd-452b-baf2-a80d97596d29 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.375689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f58b9-07bd-452b-baf2-a80d97596d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.375968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f58b9-07bd-452b-baf2-a80d97596d29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.383788 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f58b9-07bd-452b-baf2-a80d97596d29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:11.385315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f58b9-07bd-452b-baf2-a80d97596d29 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-e72f58b9-07bd-452b-baf2-a80d97596d29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 12:00:11.398514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:11.399571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 12:00:11.400586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:11.403973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 525/1066] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 12:00:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:11.405508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3010c5e-7366-4fee-8ed2-a543c47f22bd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:11.481165 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:11.514469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3010c5e-7366-4fee-8ed2-a543c47f22bd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:11.555239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6745b34-5240-415b-9b7c-6becc5b3ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:11.555994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6745b34-5240-415b-9b7c-6becc5b3ac53 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.556344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6745b34-5240-415b-9b7c-6becc5b3ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.556683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6745b34-5240-415b-9b7c-6becc5b3ac53 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.557531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6745b34-5240-415b-9b7c-6becc5b3ac53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:11.557901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6745b34-5240-415b-9b7c-6becc5b3ac53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:11.559408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6745b34-5240-415b-9b7c-6becc5b3ac53 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:11.577816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 542/1067] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 12:00:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:11.583335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f58b9-07bd-452b-baf2-a80d97596d29 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:11.650990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfed97-d12d-4ead-a721-7040c9e4c5a5 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.652105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:11.652214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfed97-d12d-4ead-a721-7040c9e4c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.652214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfed97-d12d-4ead-a721-7040c9e4c5a5 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.653220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 543/1068] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:11.658294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193e47e-ac03-482d-a5c7-ac8de3b1c7b0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.675793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193e47e-ac03-482d-a5c7-ac8de3b1c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.675793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193e47e-ac03-482d-a5c7-ac8de3b1c7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.677525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-1193e47e-ac03-482d-a5c7-ac8de3b1c7b0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:11.678732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1193e47e-ac03-482d-a5c7-ac8de3b1c7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:11.687780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f58b9-07bd-452b-baf2-a80d97596d29 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:11.724411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d01bb-087c-4800-816b-ba74b9000e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:11.725067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d01bb-087c-4800-816b-ba74b9000e01 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.725348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d01bb-087c-4800-816b-ba74b9000e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.725630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d01bb-087c-4800-816b-ba74b9000e01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.737759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d01bb-087c-4800-816b-ba74b9000e01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:11.739196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d01bb-087c-4800-816b-ba74b9000e01 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:11.753532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 544/1069] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-bb0d01bb-087c-4800-816b-ba74b9000e01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:00:11.753978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:11.754895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:00:11.755858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:00:11.755858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:11.755858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:11.755858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 526/1070] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:11.761182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193e47e-ac03-482d-a5c7-ac8de3b1c7b0 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:11.823081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:11.870040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193e47e-ac03-482d-a5c7-ac8de3b1c7b0 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:11.904859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc23783-bc54-49ef-93b2-31ca1bdf3a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:11.905389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23783-bc54-49ef-93b2-31ca1bdf3a4c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.905668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23783-bc54-49ef-93b2-31ca1bdf3a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.905940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23783-bc54-49ef-93b2-31ca1bdf3a4c None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.906582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc23783-bc54-49ef-93b2-31ca1bdf3a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:11.906907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc23783-bc54-49ef-93b2-31ca1bdf3a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:11.908668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc23783-bc54-49ef-93b2-31ca1bdf3a4c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:11.925554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 545/1071] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:11.926931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d01bb-087c-4800-816b-ba74b9000e01 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:11.960313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a703ab-7b71-4703-8a1e-fcb07f8d756d None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.961169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a703ab-7b71-4703-8a1e-fcb07f8d756d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.961612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a703ab-7b71-4703-8a1e-fcb07f8d756d None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.962960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 546/1072] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:11.968348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b691dcd-79f3-4f43-9bc9-18815b1caab6 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:11.968966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b691dcd-79f3-4f43-9bc9-18815b1caab6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:11.969469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b691dcd-79f3-4f43-9bc9-18815b1caab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:11.988209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9b691dcd-79f3-4f43-9bc9-18815b1caab6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:11.989394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9b691dcd-79f3-4f43-9bc9-18815b1caab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:12.038007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d01bb-087c-4800-816b-ba74b9000e01 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.059491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:12.091458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 547/1073] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 12:00:12.091458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b691dcd-79f3-4f43-9bc9-18815b1caab6 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:12.092248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5d9c0-23a5-49c6-b5e5-5472931aa1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:12.092248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5d9c0-23a5-49c6-b5e5-5472931aa1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:12.092248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5d9c0-23a5-49c6-b5e5-5472931aa1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:12.092248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5d9c0-23a5-49c6-b5e5-5472931aa1c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:12.092583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5d9c0-23a5-49c6-b5e5-5472931aa1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:12.092583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5d9c0-23a5-49c6-b5e5-5472931aa1c1 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-0bd5d9c0-23a5-49c6-b5e5-5472931aa1c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 12:00:12.097050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:12.098153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:12.099286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 12:00:12.099286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 12:00:12.099286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:00:12.099286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:00:12.099286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:00:12.099286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:00:12.099286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:00:12.099286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:12.107601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 527/1074] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:12.108642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5d9c0-23a5-49c6-b5e5-5472931aa1c1 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:12.129645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:12.209539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b691dcd-79f3-4f43-9bc9-18815b1caab6 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.228461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5d9c0-23a5-49c6-b5e5-5472931aa1c1 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.248624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd549a-26ba-4311-9ae4-6f304cb78ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:12.249312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd549a-26ba-4311-9ae4-6f304cb78ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:12.249540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd549a-26ba-4311-9ae4-6f304cb78ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:12.249814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd549a-26ba-4311-9ae4-6f304cb78ca0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:12.260578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd549a-26ba-4311-9ae4-6f304cb78ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:00:12.265597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b6e48-46f4-4a50-bed1-34392c66182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-debd549a-26ba-4311-9ae4-6f304cb78ca0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:00:12.266067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:12.267929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:12.268834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:12.269490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b6e48-46f4-4a50-bed1-34392c66182c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:12.269490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b6e48-46f4-4a50-bed1-34392c66182c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:12.269490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b6e48-46f4-4a50-bed1-34392c66182c None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:12.269682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 548/1075] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:00:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:12.269752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b6e48-46f4-4a50-bed1-34392c66182c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:12.269752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b6e48-46f4-4a50-bed1-34392c66182c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:12.269752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b6e48-46f4-4a50-bed1-34392c66182c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:12.272926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd549a-26ba-4311-9ae4-6f304cb78ca0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:12.283570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 528/1076] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 12:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:12.289373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b6e48-46f4-4a50-bed1-34392c66182c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:12.336735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:12.378955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd549a-26ba-4311-9ae4-6f304cb78ca0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.389297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:12.394251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b6e48-46f4-4a50-bed1-34392c66182c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.412602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4681-abb7-4b85-baf8-0fff616674fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:12.413199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4681-abb7-4b85-baf8-0fff616674fc None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:12.413473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4681-abb7-4b85-baf8-0fff616674fc None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:12.413740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4681-abb7-4b85-baf8-0fff616674fc None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:12.414392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4681-abb7-4b85-baf8-0fff616674fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:12.414693 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4681-abb7-4b85-baf8-0fff616674fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:12.416077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4681-abb7-4b85-baf8-0fff616674fc None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:12.424581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 549/1077] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:12.425365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4681-abb7-4b85-baf8-0fff616674fc None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:12.434655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d354a-a74d-474c-9148-d9cf5f157959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:12.435327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d354a-a74d-474c-9148-d9cf5f157959 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:12.435613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d354a-a74d-474c-9148-d9cf5f157959 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:12.435915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d354a-a74d-474c-9148-d9cf5f157959 None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/4971acb91bbf498887606c5ba5d00176/roles/6e4e3079bb5443eeabfe7d1c2cdb45f4` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:12.438623 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d354a-a74d-474c-9148-d9cf5f157959 None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=4971acb91bbf498887606c5ba5d00176, role_id=6e4e3079bb5443eeabfe7d1c2cdb45f4)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:12.440101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d354a-a74d-474c-9148-d9cf5f157959 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:12.510079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 529/1078] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 12:00:12 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/4971acb91bbf498887606c5ba5d00176/roles/6e4e3079bb5443eeabfe7d1c2cdb45f4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:00:12.511143 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d354a-a74d-474c-9148-d9cf5f157959 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:12.522751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4681-abb7-4b85-baf8-0fff616674fc None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.566379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1d3a-f801-4d4a-bf6c-3a6c09c320aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:12.567653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1d3a-f801-4d4a-bf6c-3a6c09c320aa None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:12.567653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1d3a-f801-4d4a-bf6c-3a6c09c320aa None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:12.567834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1d3a-f801-4d4a-bf6c-3a6c09c320aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:12.621743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:12.631860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:12.636177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d354a-a74d-474c-9148-d9cf5f157959 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.650741 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c1d3a-f801-4d4a-bf6c-3a6c09c320aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:12.652940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c1d3a-f801-4d4a-bf6c-3a6c09c320aa None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:12.673656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e65a2f-9472-4d55-9c6d-6e60d6461732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:12.674342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e65a2f-9472-4d55-9c6d-6e60d6461732 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:12.674622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e65a2f-9472-4d55-9c6d-6e60d6461732 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:12.674897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e65a2f-9472-4d55-9c6d-6e60d6461732 None admin] PATH_INFO: `/v3/users/f33270c96e494e73a88179ebedd42c0e` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:12.676119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e65a2f-9472-4d55-9c6d-6e60d6461732 None admin] RBAC: Authorizing `identity:get_user(user_id=f33270c96e494e73a88179ebedd42c0e)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:12.677591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e65a2f-9472-4d55-9c6d-6e60d6461732 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:12.684575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 530/1079] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:12 2022] GET /identity/v3/users/f33270c96e494e73a88179ebedd42c0e => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:12.686837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e65a2f-9472-4d55-9c6d-6e60d6461732 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:12.772107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 550/1080] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:12.774187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1d3a-f801-4d4a-bf6c-3a6c09c320aa None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:12.795264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e65a2f-9472-4d55-9c6d-6e60d6461732 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.831770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971e1e8-4526-4620-b526-33becb8b237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:12.832421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971e1e8-4526-4620-b526-33becb8b237f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:12.832690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971e1e8-4526-4620-b526-33becb8b237f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:12.832964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971e1e8-4526-4620-b526-33becb8b237f None admin] PATH_INFO: `/v3/projects/e6aed93d25974ea189667140f8390776` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:12.834175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971e1e8-4526-4620-b526-33becb8b237f None admin] RBAC: Authorizing `identity:get_project(project_id=e6aed93d25974ea189667140f8390776)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:12.835598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971e1e8-4526-4620-b526-33becb8b237f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:12.837411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 531/1081] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:00:12 2022] GET /identity/v3/projects/e6aed93d25974ea189667140f8390776 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:12.843738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971e1e8-4526-4620-b526-33becb8b237f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:12.851462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:12.886030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1d3a-f801-4d4a-bf6c-3a6c09c320aa None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.890289 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:12.926758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0942da-c0b4-4405-b07f-f8ed7c3404f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:12.927868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0942da-c0b4-4405-b07f-f8ed7c3404f6 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:12.928360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0942da-c0b4-4405-b07f-f8ed7c3404f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:12.928961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0942da-c0b4-4405-b07f-f8ed7c3404f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:12.942402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0942da-c0b4-4405-b07f-f8ed7c3404f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:12.944255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0942da-c0b4-4405-b07f-f8ed7c3404f6 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0e0942da-c0b4-4405-b07f-f8ed7c3404f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:00:12.960269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:12.961287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:00:12.962204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:00:12.962204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:12.962204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:12.962377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971e1e8-4526-4620-b526-33becb8b237f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:12.962452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 551/1082] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:12.967892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0942da-c0b4-4405-b07f-f8ed7c3404f6 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:13.002598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf180e72-629f-48e1-b0ca-a560ae512a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:13.003938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180e72-629f-48e1-b0ca-a560ae512a7b None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:13.004914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180e72-629f-48e1-b0ca-a560ae512a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:13.004914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180e72-629f-48e1-b0ca-a560ae512a7b None admin] PATH_INFO: `/v3/projects/e6aed93d25974ea189667140f8390776/users/f33270c96e494e73a88179ebedd42c0e/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:13.006511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf180e72-629f-48e1-b0ca-a560ae512a7b None admin] RBAC: Authorizing `identity:create_grant(project_id=e6aed93d25974ea189667140f8390776, user_id=f33270c96e494e73a88179ebedd42c0e, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:13.007979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf180e72-629f-48e1-b0ca-a560ae512a7b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:13.098080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0942da-c0b4-4405-b07f-f8ed7c3404f6 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:13.099972 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:13.113724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def49ab5-5b29-4681-aa43-2875590f7659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:13.115203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def49ab5-5b29-4681-aa43-2875590f7659 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:13.116028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def49ab5-5b29-4681-aa43-2875590f7659 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:13.116313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def49ab5-5b29-4681-aa43-2875590f7659 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:13.116975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def49ab5-5b29-4681-aa43-2875590f7659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:13.117350 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def49ab5-5b29-4681-aa43-2875590f7659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:13.118660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def49ab5-5b29-4681-aa43-2875590f7659 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:13.136346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 532/1083] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 12:00:12 2022] PUT /identity/v3/projects/e6aed93d25974ea189667140f8390776/users/f33270c96e494e73a88179ebedd42c0e/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:00:13.136593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 552/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:14.721669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f82fb-0910-4156-a9ef-6b8b7fb4003a None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:14.722249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f82fb-0910-4156-a9ef-6b8b7fb4003a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:14.722249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f82fb-0910-4156-a9ef-6b8b7fb4003a None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:14.723535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 533/1085] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:14.728835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb43b-90ee-47ea-9324-78a752364422 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:14.729256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb43b-90ee-47ea-9324-78a752364422 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:14.729567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb43b-90ee-47ea-9324-78a752364422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:14.747575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-02abb43b-90ee-47ea-9324-78a752364422 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:14.748770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-02abb43b-90ee-47ea-9324-78a752364422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:14.812502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 553/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:15.080607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f82fb-0910-4156-a9ef-6b8b7fb4003a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:15.193234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:15.199965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f82fb-0910-4156-a9ef-6b8b7fb4003a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:15.236871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb107e-e957-4168-98be-fcebad822a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:15.237527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb107e-e957-4168-98be-fcebad822a7d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:15.237805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb107e-e957-4168-98be-fcebad822a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:15.238080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb107e-e957-4168-98be-fcebad822a7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:15.250650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb107e-e957-4168-98be-fcebad822a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-87bb107e-e957-4168-98be-fcebad822a7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:00:15.255844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:15.256895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:15.258325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 534/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 12:00:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:15.263074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abb43b-90ee-47ea-9324-78a752364422 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:15.339875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a75c6-487c-4bda-ac71-39d52e3ec2f7 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:15.340081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a75c6-487c-4bda-ac71-39d52e3ec2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:15.340334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a75c6-487c-4bda-ac71-39d52e3ec2f7 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:15.341652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 535/1088] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:15.346515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4ab3-aef4-4137-9461-4420ef9fdb43 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:15.346800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4ab3-aef4-4137-9461-4420ef9fdb43 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:15.347077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4ab3-aef4-4137-9461-4420ef9fdb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:15.363560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abb43b-90ee-47ea-9324-78a752364422 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:15.365295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f61c4ab3-aef4-4137-9461-4420ef9fdb43 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:15.366482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f61c4ab3-aef4-4137-9461-4420ef9fdb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:15.378025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:15.397833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc6bb2-abbf-4617-a41a-a9375ead39cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:15.398399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc6bb2-abbf-4617-a41a-a9375ead39cb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:15.398679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc6bb2-abbf-4617-a41a-a9375ead39cb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:15.398954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc6bb2-abbf-4617-a41a-a9375ead39cb None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:15.399641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc6bb2-abbf-4617-a41a-a9375ead39cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:15.399958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc6bb2-abbf-4617-a41a-a9375ead39cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:15.401841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc6bb2-abbf-4617-a41a-a9375ead39cb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:15.410728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 554/1089] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 12:00:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:15.416563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc6bb2-abbf-4617-a41a-a9375ead39cb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:15.440926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 536/1090] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 12:00:15.516066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc6bb2-abbf-4617-a41a-a9375ead39cb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:15.551259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbdef6-12af-4975-99af-b58eeeb4ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:15.551958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbdef6-12af-4975-99af-b58eeeb4ff43 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:15.552243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbdef6-12af-4975-99af-b58eeeb4ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:15.552518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbdef6-12af-4975-99af-b58eeeb4ff43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:15.562728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbdef6-12af-4975-99af-b58eeeb4ff43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:15.564220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbdef6-12af-4975-99af-b58eeeb4ff43 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-3bbbdef6-12af-4975-99af-b58eeeb4ff43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:00:15.578005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:15.579039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:00:15.579995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:00:15.579995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:15.579995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:15.579995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 555/1091] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:15.584962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4ab3-aef4-4137-9461-4420ef9fdb43 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:15.670786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:15.684681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4ab3-aef4-4137-9461-4420ef9fdb43 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:15.710333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbdef6-12af-4975-99af-b58eeeb4ff43 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:15.719535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dccd5f-1fc3-459b-8b16-26aabbb033b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:15.720178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dccd5f-1fc3-459b-8b16-26aabbb033b7 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:15.720467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dccd5f-1fc3-459b-8b16-26aabbb033b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:15.720739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dccd5f-1fc3-459b-8b16-26aabbb033b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:15.721382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dccd5f-1fc3-459b-8b16-26aabbb033b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:15.721690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dccd5f-1fc3-459b-8b16-26aabbb033b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:15.723062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dccd5f-1fc3-459b-8b16-26aabbb033b7 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:15.739795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 537/1092] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:15.740857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dccd5f-1fc3-459b-8b16-26aabbb033b7 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:15.747164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:15.831560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbdef6-12af-4975-99af-b58eeeb4ff43 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:15.843652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dccd5f-1fc3-459b-8b16-26aabbb033b7 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:15.865431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c09b3-01ec-455c-82b7-5253308065c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:15.866148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c09b3-01ec-455c-82b7-5253308065c4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:15.866431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c09b3-01ec-455c-82b7-5253308065c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:15.866702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c09b3-01ec-455c-82b7-5253308065c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:15.876658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c09b3-01ec-455c-82b7-5253308065c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:00:15.876812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a039f1b-d058-4e69-91e4-9e3e13c69524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:15.877415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a039f1b-d058-4e69-91e4-9e3e13c69524 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:15.877691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a039f1b-d058-4e69-91e4-9e3e13c69524 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:15.878223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a039f1b-d058-4e69-91e4-9e3e13c69524 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-610c09b3-01ec-455c-82b7-5253308065c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:00:15.881728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:15.882841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:15.883764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 556/1093] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:15.886985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a039f1b-d058-4e69-91e4-9e3e13c69524 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:15.888447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a039f1b-d058-4e69-91e4-9e3e13c69524 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:15.889305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c09b3-01ec-455c-82b7-5253308065c4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-6a039f1b-d058-4e69-91e4-9e3e13c69524 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 12:00:15.899727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:15.900935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:15.902497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 538/1094] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 12:00:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:15.907115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a039f1b-d058-4e69-91e4-9e3e13c69524 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:15.917367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:15.985504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:15.997759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c09b3-01ec-455c-82b7-5253308065c4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.009848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a039f1b-d058-4e69-91e4-9e3e13c69524 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.034022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e827af0-a4be-4ed6-91a9-37215da27bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.034631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e827af0-a4be-4ed6-91a9-37215da27bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.034915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e827af0-a4be-4ed6-91a9-37215da27bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.035193 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e827af0-a4be-4ed6-91a9-37215da27bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.035889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e827af0-a4be-4ed6-91a9-37215da27bb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:16.036196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e827af0-a4be-4ed6-91a9-37215da27bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.037547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e827af0-a4be-4ed6-91a9-37215da27bb4 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.044657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1d3e-2fc9-45d1-ae3a-6b250ed4add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.045269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1d3e-2fc9-45d1-ae3a-6b250ed4add6 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.045556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1d3e-2fc9-45d1-ae3a-6b250ed4add6 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.045703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 557/1095] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:16.045857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1d3e-2fc9-45d1-ae3a-6b250ed4add6 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.046555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1d3e-2fc9-45d1-ae3a-6b250ed4add6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:16.046961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1d3e-2fc9-45d1-ae3a-6b250ed4add6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.048315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1d3e-2fc9-45d1-ae3a-6b250ed4add6 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.051513 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e827af0-a4be-4ed6-91a9-37215da27bb4 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:16.066319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 539/1096] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 12:00:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:16.072068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1d3e-2fc9-45d1-ae3a-6b250ed4add6 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:16.134748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:16.150131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e827af0-a4be-4ed6-91a9-37215da27bb4 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.172416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1d3e-2fc9-45d1-ae3a-6b250ed4add6 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.181892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23997b-e280-42cd-9b8e-c5e96a68cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.183002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23997b-e280-42cd-9b8e-c5e96a68cf13 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.183287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23997b-e280-42cd-9b8e-c5e96a68cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.183557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23997b-e280-42cd-9b8e-c5e96a68cf13 None admin] PATH_INFO: `/v3/users/f33270c96e494e73a88179ebedd42c0e` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.184713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23997b-e280-42cd-9b8e-c5e96a68cf13 None admin] RBAC: Authorizing `identity:get_user(user_id=f33270c96e494e73a88179ebedd42c0e)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.186129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23997b-e280-42cd-9b8e-c5e96a68cf13 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.187725 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 558/1097] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:16 2022] GET /identity/v3/users/f33270c96e494e73a88179ebedd42c0e => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:16.193492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23997b-e280-42cd-9b8e-c5e96a68cf13 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:16.207923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72660d-b222-4207-8b2a-57fa448ccac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.208533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72660d-b222-4207-8b2a-57fa448ccac4 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.208812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72660d-b222-4207-8b2a-57fa448ccac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.209086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72660d-b222-4207-8b2a-57fa448ccac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.215296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:16.280310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72660d-b222-4207-8b2a-57fa448ccac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.281671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72660d-b222-4207-8b2a-57fa448ccac4 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.291583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23997b-e280-42cd-9b8e-c5e96a68cf13 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.324927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b02e95-c660-4b96-b370-70776352b5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.325528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b02e95-c660-4b96-b370-70776352b5bf None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.325804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b02e95-c660-4b96-b370-70776352b5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.326078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b02e95-c660-4b96-b370-70776352b5bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.340644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:16.379201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 540/1098] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 12:00:16.384691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72660d-b222-4207-8b2a-57fa448ccac4 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:16.396023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b02e95-c660-4b96-b370-70776352b5bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.397537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b02e95-c660-4b96-b370-70776352b5bf None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.414444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:16.489901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72660d-b222-4207-8b2a-57fa448ccac4 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.502482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 559/1099] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 12:00:16.508909 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b02e95-c660-4b96-b370-70776352b5bf None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:16.524212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c13a73-6771-4ada-a110-c120023d76cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.524844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c13a73-6771-4ada-a110-c120023d76cc None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.525125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c13a73-6771-4ada-a110-c120023d76cc None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.525393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c13a73-6771-4ada-a110-c120023d76cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.535357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c13a73-6771-4ada-a110-c120023d76cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.536772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c13a73-6771-4ada-a110-c120023d76cc None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-36c13a73-6771-4ada-a110-c120023d76cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:00:16.551535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:16.552711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:00:16.553805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:00:16.553805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:00:16.553805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:16.553805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 541/1100] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:16.558924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c13a73-6771-4ada-a110-c120023d76cc None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:16.577590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:16.608884 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b02e95-c660-4b96-b370-70776352b5bf None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.626557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:16.643966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751e8c9-1df0-4bab-b452-edcce1aaf249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.644600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751e8c9-1df0-4bab-b452-edcce1aaf249 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.644882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751e8c9-1df0-4bab-b452-edcce1aaf249 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.645160 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751e8c9-1df0-4bab-b452-edcce1aaf249 None admin] PATH_INFO: `/v3/projects/e6aed93d25974ea189667140f8390776` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.646284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751e8c9-1df0-4bab-b452-edcce1aaf249 None admin] RBAC: Authorizing `identity:get_project(project_id=e6aed93d25974ea189667140f8390776)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.647745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751e8c9-1df0-4bab-b452-edcce1aaf249 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.649391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 560/1101] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:00:16 2022] GET /identity/v3/projects/e6aed93d25974ea189667140f8390776 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:16.655366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751e8c9-1df0-4bab-b452-edcce1aaf249 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:16.664096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c13a73-6771-4ada-a110-c120023d76cc None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.697954 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3adf0c-cfbf-4b7d-a097-377f0227d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.698562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3adf0c-cfbf-4b7d-a097-377f0227d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.698839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3adf0c-cfbf-4b7d-a097-377f0227d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.699107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3adf0c-cfbf-4b7d-a097-377f0227d8b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.699850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3adf0c-cfbf-4b7d-a097-377f0227d8b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:16.700158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3adf0c-cfbf-4b7d-a097-377f0227d8b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.701532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3adf0c-cfbf-4b7d-a097-377f0227d8b7 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.713218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 542/1102] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:16.718776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3adf0c-cfbf-4b7d-a097-377f0227d8b7 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:16.754072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751e8c9-1df0-4bab-b452-edcce1aaf249 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.787175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5710f-8353-466a-8086-fb69a2ab68c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.787740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5710f-8353-466a-8086-fb69a2ab68c8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.788025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5710f-8353-466a-8086-fb69a2ab68c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.788302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5710f-8353-466a-8086-fb69a2ab68c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.789019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5710f-8353-466a-8086-fb69a2ab68c8 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=e6aed93d25974ea189667140f8390776, user.id=f33270c96e494e73a88179ebedd42c0e) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:16.789329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5710f-8353-466a-8086-fb69a2ab68c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.790761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5710f-8353-466a-8086-fb69a2ab68c8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.793499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:16.797591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 561/1103] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:00:16 2022] GET /identity/v3/role_assignments?user.id=f33270c96e494e73a88179ebedd42c0e&scope.project.id=e6aed93d25974ea189667140f8390776&role.id=06592016669243d99b430c46dd1c1d46 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:16.816512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3adf0c-cfbf-4b7d-a097-377f0227d8b7 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:16.856059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240d1e4-504f-4d04-b70c-0ff3c99d99e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:16.856721 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240d1e4-504f-4d04-b70c-0ff3c99d99e0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:16.857003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240d1e4-504f-4d04-b70c-0ff3c99d99e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:16.857280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240d1e4-504f-4d04-b70c-0ff3c99d99e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:16.865046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240d1e4-504f-4d04-b70c-0ff3c99d99e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:16.866519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240d1e4-504f-4d04-b70c-0ff3c99d99e0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-3240d1e4-504f-4d04-b70c-0ff3c99d99e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 12:00:16.878979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:16.880193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:16.881679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 12:00:16.881679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 12:00:16.881679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:00:16.881679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:00:16.881679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:00:16.881679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:00:16.881679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:00:16.881679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:16.881679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 543/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:00:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:00:16.886274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5710f-8353-466a-8086-fb69a2ab68c8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:16.940793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:16.993492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5710f-8353-466a-8086-fb69a2ab68c8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:17.037302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a8442-e4ab-46fa-8ff9-3bf9c3b23371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:17.037836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a8442-e4ab-46fa-8ff9-3bf9c3b23371 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:17.038120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a8442-e4ab-46fa-8ff9-3bf9c3b23371 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:17.038399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a8442-e4ab-46fa-8ff9-3bf9c3b23371 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:17.039094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a8442-e4ab-46fa-8ff9-3bf9c3b23371 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:17.039401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a8442-e4ab-46fa-8ff9-3bf9c3b23371 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:17.040843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a8442-e4ab-46fa-8ff9-3bf9c3b23371 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:17.053323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 562/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 12:00:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:17.059615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240d1e4-504f-4d04-b70c-0ff3c99d99e0 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:17.163106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240d1e4-504f-4d04-b70c-0ff3c99d99e0 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:17.195607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7a690-9646-42f1-b374-b07578352f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:17.196287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a690-9646-42f1-b374-b07578352f49 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:17.196573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a690-9646-42f1-b374-b07578352f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:17.196846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a690-9646-42f1-b374-b07578352f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:17.197571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a690-9646-42f1-b374-b07578352f49 None admin] RBAC: Adding query filter params (role.id=6e4e3079bb5443eeabfe7d1c2cdb45f4, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=4971acb91bbf498887606c5ba5d00176) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:17.197889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a690-9646-42f1-b374-b07578352f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:17.199849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a690-9646-42f1-b374-b07578352f49 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:17.202795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:17.206135 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 544/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:00:17 2022] GET /identity/v3/role_assignments?user.id=4971acb91bbf498887606c5ba5d00176&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=6e4e3079bb5443eeabfe7d1c2cdb45f4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:19.006296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88eab-8ee4-42ab-b4bc-42c43db236c6 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:19.006879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88eab-8ee4-42ab-b4bc-42c43db236c6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:19.006879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88eab-8ee4-42ab-b4bc-42c43db236c6 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:19.008218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 563/1107] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:19.013681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ad9aa-7e3a-49f5-878f-067d91530df3 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:19.014090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ad9aa-7e3a-49f5-878f-067d91530df3 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:19.014256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ad9aa-7e3a-49f5-878f-067d91530df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:19.032880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-710ad9aa-7e3a-49f5-878f-067d91530df3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:19.034060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-710ad9aa-7e3a-49f5-878f-067d91530df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:19.098675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 545/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:19.369997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88eab-8ee4-42ab-b4bc-42c43db236c6 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:19.468002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88eab-8ee4-42ab-b4bc-42c43db236c6 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:19.478426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:19.500626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaa700-7853-4dd1-89d1-bc837ab3ed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:19.501257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa700-7853-4dd1-89d1-bc837ab3ed71 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:19.501538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa700-7853-4dd1-89d1-bc837ab3ed71 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:19.501813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa700-7853-4dd1-89d1-bc837ab3ed71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:19.502918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaa700-7853-4dd1-89d1-bc837ab3ed71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:19.504627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaa700-7853-4dd1-89d1-bc837ab3ed71 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:19.506830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 564/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:19.512598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ad9aa-7e3a-49f5-878f-067d91530df3 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:19.628910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ad9aa-7e3a-49f5-878f-067d91530df3 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:19.657380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:19.662961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fae62-ed0c-440f-944d-890c9e82f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:19.663614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fae62-ed0c-440f-944d-890c9e82f868 None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:19.663926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fae62-ed0c-440f-944d-890c9e82f868 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:19.664200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fae62-ed0c-440f-944d-890c9e82f868 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:19.665986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fae62-ed0c-440f-944d-890c9e82f868 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:19.666334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fae62-ed0c-440f-944d-890c9e82f868 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:19.747641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 546/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 12:00:19 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:00:21.932309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00398a6f-1f72-49b4-9339-7b1183e5ffa2 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:21.932881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00398a6f-1f72-49b4-9339-7b1183e5ffa2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:21.934682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00398a6f-1f72-49b4-9339-7b1183e5ffa2 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:21.935392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 565/1111] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:21.940892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab05cd-ef8a-4f1e-8931-2ab3aa517400 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:21.941354 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab05cd-ef8a-4f1e-8931-2ab3aa517400 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:21.944262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab05cd-ef8a-4f1e-8931-2ab3aa517400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:21.961333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a7ab05cd-ef8a-4f1e-8931-2ab3aa517400 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:21.962523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a7ab05cd-ef8a-4f1e-8931-2ab3aa517400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:22.029856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 547/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:22.299242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00398a6f-1f72-49b4-9339-7b1183e5ffa2 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:22.396801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00398a6f-1f72-49b4-9339-7b1183e5ffa2 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:22.428723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935a3a3-d536-46af-b5c1-d363d18ecf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:22.429338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935a3a3-d536-46af-b5c1-d363d18ecf2b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:22.429619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935a3a3-d536-46af-b5c1-d363d18ecf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:22.429890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935a3a3-d536-46af-b5c1-d363d18ecf2b None admin] PATH_INFO: `/v3/roles/1387b2da4fc147fe99310c8bea8504be` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:22.431288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935a3a3-d536-46af-b5c1-d363d18ecf2b None admin] RBAC: Authorizing `identity:get_role(role_id=1387b2da4fc147fe99310c8bea8504be)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:22.432675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935a3a3-d536-46af-b5c1-d363d18ecf2b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:22.434597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 566/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:22 2022] GET /identity/v3/roles/1387b2da4fc147fe99310c8bea8504be => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:22.441138 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab05cd-ef8a-4f1e-8931-2ab3aa517400 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:22.537954 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab05cd-ef8a-4f1e-8931-2ab3aa517400 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:22.554550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:22.572107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c07ccb-f16c-4121-9990-8816b09fc8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:22.578731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c07ccb-f16c-4121-9990-8816b09fc8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:22.578731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c07ccb-f16c-4121-9990-8816b09fc8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:22.578731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c07ccb-f16c-4121-9990-8816b09fc8d9 None admin] PATH_INFO: `/v3/users/6d41c9da3b974e96ac0bea5d4498f1e6` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:22.586164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c07ccb-f16c-4121-9990-8816b09fc8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=6d41c9da3b974e96ac0bea5d4498f1e6)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:22.587650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c07ccb-f16c-4121-9990-8816b09fc8d9 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:22.589263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 548/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:22 2022] GET /identity/v3/users/6d41c9da3b974e96ac0bea5d4498f1e6 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:22.595284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935a3a3-d536-46af-b5c1-d363d18ecf2b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:22.641578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:22.695338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935a3a3-d536-46af-b5c1-d363d18ecf2b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:22.729098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207c7ee-cff6-479e-aa4c-b7744514b834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:22.730239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c7ee-cff6-479e-aa4c-b7744514b834 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:22.730659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c7ee-cff6-479e-aa4c-b7744514b834 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:22.730941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c7ee-cff6-479e-aa4c-b7744514b834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:22.796558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207c7ee-cff6-479e-aa4c-b7744514b834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:22.798002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207c7ee-cff6-479e-aa4c-b7744514b834 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:22.841532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:22.893093 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 567/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:22.899049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c07ccb-f16c-4121-9990-8816b09fc8d9 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:22.995781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c07ccb-f16c-4121-9990-8816b09fc8d9 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:23.028918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71462b0-1718-4d77-9103-c5b439bec742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:23.029541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71462b0-1718-4d77-9103-c5b439bec742 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:23.029828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71462b0-1718-4d77-9103-c5b439bec742 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:23.030104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71462b0-1718-4d77-9103-c5b439bec742 None admin] PATH_INFO: `/v3/projects/e6aed93d25974ea189667140f8390776` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:23.031218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71462b0-1718-4d77-9103-c5b439bec742 None admin] RBAC: Authorizing `identity:get_project(project_id=e6aed93d25974ea189667140f8390776)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:23.032678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71462b0-1718-4d77-9103-c5b439bec742 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:23.034293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 549/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:00:22 2022] GET /identity/v3/projects/e6aed93d25974ea189667140f8390776 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:23.040516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207c7ee-cff6-479e-aa4c-b7744514b834 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:23.137866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207c7ee-cff6-479e-aa4c-b7744514b834 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:23.171316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a12cd-3082-47ad-8286-f1b2bb942e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:23.171939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a12cd-3082-47ad-8286-f1b2bb942e4f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:23.172222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a12cd-3082-47ad-8286-f1b2bb942e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:23.172495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a12cd-3082-47ad-8286-f1b2bb942e4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:23.173210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a12cd-3082-47ad-8286-f1b2bb942e4f None admin] RBAC: Adding query filter params (role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=e6aed93d25974ea189667140f8390776, user.id=6d41c9da3b974e96ac0bea5d4498f1e6) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:23.173523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a12cd-3082-47ad-8286-f1b2bb942e4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:23.174938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a12cd-3082-47ad-8286-f1b2bb942e4f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:23.180218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 568/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:00:23 2022] GET /identity/v3/role_assignments?user.id=6d41c9da3b974e96ac0bea5d4498f1e6&scope.project.id=e6aed93d25974ea189667140f8390776&role.id=1387b2da4fc147fe99310c8bea8504be => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:25.282128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c4485-4f4c-4541-8359-27b9fe620cce None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:25.282692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c4485-4f4c-4541-8359-27b9fe620cce None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:25.282692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c4485-4f4c-4541-8359-27b9fe620cce None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:25.284024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 550/1118] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:25.289078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ace52-b88f-4086-acb2-7c567f67e65a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:25.289500 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ace52-b88f-4086-acb2-7c567f67e65a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:25.289633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ace52-b88f-4086-acb2-7c567f67e65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:25.307379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d03ace52-b88f-4086-acb2-7c567f67e65a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:25.309102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d03ace52-b88f-4086-acb2-7c567f67e65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:25.311828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:25.373335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 569/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:25.645664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c4485-4f4c-4541-8359-27b9fe620cce None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:25.688853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:25.748795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c4485-4f4c-4541-8359-27b9fe620cce None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:25.784263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e7710-d5c8-4426-a670-8a136049d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:25.784892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e7710-d5c8-4426-a670-8a136049d37a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:25.785173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e7710-d5c8-4426-a670-8a136049d37a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:25.785448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e7710-d5c8-4426-a670-8a136049d37a None admin] PATH_INFO: `/v3/roles/1387b2da4fc147fe99310c8bea8504be` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:25.786819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e7710-d5c8-4426-a670-8a136049d37a None admin] RBAC: Authorizing `identity:get_role(role_id=1387b2da4fc147fe99310c8bea8504be)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:25.788206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e7710-d5c8-4426-a670-8a136049d37a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:25.789560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 551/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:25 2022] GET /identity/v3/roles/1387b2da4fc147fe99310c8bea8504be => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:25.795689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ace52-b88f-4086-acb2-7c567f67e65a None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:25.906845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ace52-b88f-4086-acb2-7c567f67e65a None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:25.940100 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbfea6-c31b-449a-b927-76850028f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:25.940728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbfea6-c31b-449a-b927-76850028f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:25.941006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbfea6-c31b-449a-b927-76850028f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:25.941280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbfea6-c31b-449a-b927-76850028f9c2 None admin] PATH_INFO: `/v3/users/6d41c9da3b974e96ac0bea5d4498f1e6` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:25.942391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbfea6-c31b-449a-b927-76850028f9c2 None admin] RBAC: Authorizing `identity:get_user(user_id=6d41c9da3b974e96ac0bea5d4498f1e6)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:25.943872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbfea6-c31b-449a-b927-76850028f9c2 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:25.945445 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 570/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:25 2022] GET /identity/v3/users/6d41c9da3b974e96ac0bea5d4498f1e6 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:25.952062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e7710-d5c8-4426-a670-8a136049d37a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:26.054610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e7710-d5c8-4426-a670-8a136049d37a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:26.065615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:26.088612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f519b-3e69-46e3-bf39-037f63d29cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:26.089241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f519b-3e69-46e3-bf39-037f63d29cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:26.089525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f519b-3e69-46e3-bf39-037f63d29cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:26.089801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f519b-3e69-46e3-bf39-037f63d29cb3 None admin] PATH_INFO: `/v3/projects/e6aed93d25974ea189667140f8390776` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:26.090892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f519b-3e69-46e3-bf39-037f63d29cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=e6aed93d25974ea189667140f8390776)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:26.092370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f519b-3e69-46e3-bf39-037f63d29cb3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:26.093972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 552/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:00:25 2022] GET /identity/v3/projects/e6aed93d25974ea189667140f8390776 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:26.100235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbfea6-c31b-449a-b927-76850028f9c2 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:26.111021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:26.210065 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbfea6-c31b-449a-b927-76850028f9c2 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:26.244382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fa80d-cd0f-4ffd-9019-be59d4ed9e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:26.245036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fa80d-cd0f-4ffd-9019-be59d4ed9e6b None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:26.245315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fa80d-cd0f-4ffd-9019-be59d4ed9e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:26.246227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fa80d-cd0f-4ffd-9019-be59d4ed9e6b None admin] PATH_INFO: `/v3/projects/e6aed93d25974ea189667140f8390776/users/6d41c9da3b974e96ac0bea5d4498f1e6/roles/1387b2da4fc147fe99310c8bea8504be` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:26.248317 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fa80d-cd0f-4ffd-9019-be59d4ed9e6b None admin] RBAC: Authorizing `identity:create_grant(project_id=e6aed93d25974ea189667140f8390776, user_id=6d41c9da3b974e96ac0bea5d4498f1e6, role_id=1387b2da4fc147fe99310c8bea8504be)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:26.249746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fa80d-cd0f-4ffd-9019-be59d4ed9e6b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:26.327638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 571/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 12:00:26 2022] PUT /identity/v3/projects/e6aed93d25974ea189667140f8390776/users/6d41c9da3b974e96ac0bea5d4498f1e6/roles/1387b2da4fc147fe99310c8bea8504be => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:00:28.489576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d5679-42a8-4e1b-8851-02c51ba5be2e None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:28.490097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d5679-42a8-4e1b-8851-02c51ba5be2e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:28.490097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d5679-42a8-4e1b-8851-02c51ba5be2e None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:28.491346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 553/1124] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:28.497545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daf2d0-0702-4c75-959a-014f1c5acf9b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:28.497970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daf2d0-0702-4c75-959a-014f1c5acf9b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:28.498098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daf2d0-0702-4c75-959a-014f1c5acf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:28.516179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f6daf2d0-0702-4c75-959a-014f1c5acf9b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:28.517367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f6daf2d0-0702-4c75-959a-014f1c5acf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:28.577094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:28.584144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 572/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:28.877926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d5679-42a8-4e1b-8851-02c51ba5be2e None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:28.987544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d5679-42a8-4e1b-8851-02c51ba5be2e None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:29.021325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399b003-9551-450f-a067-d4a4398945e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:29.021949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399b003-9551-450f-a067-d4a4398945e2 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:29.022230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399b003-9551-450f-a067-d4a4398945e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:29.022502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399b003-9551-450f-a067-d4a4398945e2 None admin] PATH_INFO: `/v3/roles/1387b2da4fc147fe99310c8bea8504be` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:29.023905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399b003-9551-450f-a067-d4a4398945e2 None admin] RBAC: Authorizing `identity:get_role(role_id=1387b2da4fc147fe99310c8bea8504be)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:29.025265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399b003-9551-450f-a067-d4a4398945e2 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:29.026672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 554/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:28 2022] GET /identity/v3/roles/1387b2da4fc147fe99310c8bea8504be => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:29.032965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daf2d0-0702-4c75-959a-014f1c5acf9b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:29.128873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daf2d0-0702-4c75-959a-014f1c5acf9b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:29.162266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed204a-fdab-4eb5-b1a6-81eb9cb2912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:29.162881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed204a-fdab-4eb5-b1a6-81eb9cb2912f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:29.163163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed204a-fdab-4eb5-b1a6-81eb9cb2912f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:29.163436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed204a-fdab-4eb5-b1a6-81eb9cb2912f None admin] PATH_INFO: `/v3/users/6d41c9da3b974e96ac0bea5d4498f1e6` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:29.164567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed204a-fdab-4eb5-b1a6-81eb9cb2912f None admin] RBAC: Authorizing `identity:get_user(user_id=6d41c9da3b974e96ac0bea5d4498f1e6)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:29.165970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed204a-fdab-4eb5-b1a6-81eb9cb2912f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:29.167714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 573/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:29 2022] GET /identity/v3/users/6d41c9da3b974e96ac0bea5d4498f1e6 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:29.173492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399b003-9551-450f-a067-d4a4398945e2 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:29.220366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:29.274148 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399b003-9551-450f-a067-d4a4398945e2 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:29.307490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826ef88-168d-4952-b511-abf38af64959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:29.308123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826ef88-168d-4952-b511-abf38af64959 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:29.308405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826ef88-168d-4952-b511-abf38af64959 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:29.308683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826ef88-168d-4952-b511-abf38af64959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:29.373330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826ef88-168d-4952-b511-abf38af64959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:29.374758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826ef88-168d-4952-b511-abf38af64959 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:29.418044 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:29.471155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 555/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:29.477139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed204a-fdab-4eb5-b1a6-81eb9cb2912f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:29.539478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:29.572030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed204a-fdab-4eb5-b1a6-81eb9cb2912f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:29.603871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414b452-b79a-4005-93ae-d78a8dab7114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:29.604485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414b452-b79a-4005-93ae-d78a8dab7114 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:29.604761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414b452-b79a-4005-93ae-d78a8dab7114 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:29.605055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414b452-b79a-4005-93ae-d78a8dab7114 None admin] PATH_INFO: `/v3/projects/e6aed93d25974ea189667140f8390776` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:29.606150 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414b452-b79a-4005-93ae-d78a8dab7114 None admin] RBAC: Authorizing `identity:get_project(project_id=e6aed93d25974ea189667140f8390776)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:29.607558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414b452-b79a-4005-93ae-d78a8dab7114 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:29.609177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 574/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:00:29 2022] GET /identity/v3/projects/e6aed93d25974ea189667140f8390776 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:29.615320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826ef88-168d-4952-b511-abf38af64959 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:29.711642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826ef88-168d-4952-b511-abf38af64959 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:29.744674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3ef3a-c782-4172-8e0e-1ea9afbfbd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:29.745274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3ef3a-c782-4172-8e0e-1ea9afbfbd7c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:29.745557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3ef3a-c782-4172-8e0e-1ea9afbfbd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:29.746364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3ef3a-c782-4172-8e0e-1ea9afbfbd7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:29.747080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3ef3a-c782-4172-8e0e-1ea9afbfbd7c None admin] RBAC: Adding query filter params (role.id=1387b2da4fc147fe99310c8bea8504be, scope.project.id=e6aed93d25974ea189667140f8390776, user.id=6d41c9da3b974e96ac0bea5d4498f1e6) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:29.747391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3ef3a-c782-4172-8e0e-1ea9afbfbd7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:29.748856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3ef3a-c782-4172-8e0e-1ea9afbfbd7c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:29.754708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 556/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:00:29 2022] GET /identity/v3/role_assignments?user.id=6d41c9da3b974e96ac0bea5d4498f1e6&scope.project.id=e6aed93d25974ea189667140f8390776&role.id=1387b2da4fc147fe99310c8bea8504be => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:31.934001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013d3b6-5ab9-41cc-9c66-22a878cc174c None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:31.934595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013d3b6-5ab9-41cc-9c66-22a878cc174c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:31.934595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013d3b6-5ab9-41cc-9c66-22a878cc174c None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:31.935932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 575/1131] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:31.941253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322525c8-54e2-4706-b953-db8080629c78 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:31.941629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322525c8-54e2-4706-b953-db8080629c78 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:31.941807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322525c8-54e2-4706-b953-db8080629c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:31.959556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-322525c8-54e2-4706-b953-db8080629c78 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:31.960771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-322525c8-54e2-4706-b953-db8080629c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:31.963503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:32.031189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 557/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:32.307115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013d3b6-5ab9-41cc-9c66-22a878cc174c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:32.405107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013d3b6-5ab9-41cc-9c66-22a878cc174c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:32.437820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d40f8e-0165-4886-bc0e-a8f8099b55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:32.438456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d40f8e-0165-4886-bc0e-a8f8099b55cc None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:32.438740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d40f8e-0165-4886-bc0e-a8f8099b55cc None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:32.439016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d40f8e-0165-4886-bc0e-a8f8099b55cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:32.440291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d40f8e-0165-4886-bc0e-a8f8099b55cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:32.441571 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d40f8e-0165-4886-bc0e-a8f8099b55cc None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:32.443146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 576/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:32.449532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322525c8-54e2-4706-b953-db8080629c78 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:32.549375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322525c8-54e2-4706-b953-db8080629c78 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:32.583058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b868e3-e3c6-4364-b832-165866bafd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:32.583689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b868e3-e3c6-4364-b832-165866bafd7f None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:32.583974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b868e3-e3c6-4364-b832-165866bafd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:32.584250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b868e3-e3c6-4364-b832-165866bafd7f None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:32.584907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b868e3-e3c6-4364-b832-165866bafd7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:32.586335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b868e3-e3c6-4364-b832-165866bafd7f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:32.596997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:32.694655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 558/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 12:00:32 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:00:34.875903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e53ba4-35de-485a-8c12-fc32d2e62c7c None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:34.876467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e53ba4-35de-485a-8c12-fc32d2e62c7c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:34.876467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e53ba4-35de-485a-8c12-fc32d2e62c7c None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:34.877756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 577/1135] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:34.883464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca9f4-5e12-4504-9c6e-94807358341f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:34.883927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca9f4-5e12-4504-9c6e-94807358341f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:34.884047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca9f4-5e12-4504-9c6e-94807358341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:34.901808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6e8ca9f4-5e12-4504-9c6e-94807358341f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:34.903548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6e8ca9f4-5e12-4504-9c6e-94807358341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:34.972127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 559/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:35.242890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e53ba4-35de-485a-8c12-fc32d2e62c7c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:35.245896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:35.346422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e53ba4-35de-485a-8c12-fc32d2e62c7c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:35.381766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a73c8-934d-48cb-a193-764fcbf141db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:35.382403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a73c8-934d-48cb-a193-764fcbf141db None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:35.382685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a73c8-934d-48cb-a193-764fcbf141db None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:35.382957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a73c8-934d-48cb-a193-764fcbf141db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:35.384151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a73c8-934d-48cb-a193-764fcbf141db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:35.385586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a73c8-934d-48cb-a193-764fcbf141db None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:35.387774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 578/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:00:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:35.394164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ca9f4-5e12-4504-9c6e-94807358341f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:35.494104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ca9f4-5e12-4504-9c6e-94807358341f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:35.517297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:35.529469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d133e-6f4b-492e-9686-aedf50831e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:35.530085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d133e-6f4b-492e-9686-aedf50831e2c None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:35.530372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d133e-6f4b-492e-9686-aedf50831e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:35.530649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d133e-6f4b-492e-9686-aedf50831e2c None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:35.531316 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d133e-6f4b-492e-9686-aedf50831e2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:35.532791 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d133e-6f4b-492e-9686-aedf50831e2c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:35.648733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 560/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 12:00:35 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:00:37.850731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b3375-5156-42de-948d-3c539c6d9b4f None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:37.851276 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b3375-5156-42de-948d-3c539c6d9b4f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:37.851276 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b3375-5156-42de-948d-3c539c6d9b4f None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:37.852744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 579/1139] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:37.858819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b5efc-4217-4542-b328-227012e26936 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:37.859220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b5efc-4217-4542-b328-227012e26936 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:37.859372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b5efc-4217-4542-b328-227012e26936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:37.878083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8c0b5efc-4217-4542-b328-227012e26936 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:37.879549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8c0b5efc-4217-4542-b328-227012e26936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:37.944618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 561/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:38.219675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b3375-5156-42de-948d-3c539c6d9b4f None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:38.288589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:38.319042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b3375-5156-42de-948d-3c539c6d9b4f None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:38.352659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d6d48-6ff7-4905-8fdd-3f93b540aece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:38.353269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d6d48-6ff7-4905-8fdd-3f93b540aece None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:38.353546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d6d48-6ff7-4905-8fdd-3f93b540aece None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:38.353835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d6d48-6ff7-4905-8fdd-3f93b540aece None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:38.363428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d6d48-6ff7-4905-8fdd-3f93b540aece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-853d6d48-6ff7-4905-8fdd-3f93b540aece None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:00:38.368273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:38.369387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:38.370242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 580/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:38.375365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b5efc-4217-4542-b328-227012e26936 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:38.474508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b5efc-4217-4542-b328-227012e26936 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:38.483884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:38.508358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59877d1a-5862-4022-928f-f8367ba82e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:38.509076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877d1a-5862-4022-928f-f8367ba82e19 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:38.509451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877d1a-5862-4022-928f-f8367ba82e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:38.509959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877d1a-5862-4022-928f-f8367ba82e19 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:38.510711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59877d1a-5862-4022-928f-f8367ba82e19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:38.511113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59877d1a-5862-4022-928f-f8367ba82e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:38.513226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59877d1a-5862-4022-928f-f8367ba82e19 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:38.521212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 562/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:38.528079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d6d48-6ff7-4905-8fdd-3f93b540aece None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:38.624281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d6d48-6ff7-4905-8fdd-3f93b540aece None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:38.652752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:38.658418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecc951-86ad-44d7-aa0c-6eb29b855afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:38.659038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecc951-86ad-44d7-aa0c-6eb29b855afe None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:38.659317 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecc951-86ad-44d7-aa0c-6eb29b855afe None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:38.659593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecc951-86ad-44d7-aa0c-6eb29b855afe None admin] PATH_INFO: `/v3/users/6c7385031bec484aa3f10a779e1e4db9` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:38.672242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecc951-86ad-44d7-aa0c-6eb29b855afe None admin] RBAC: Authorizing `identity:get_user(user_id=6c7385031bec484aa3f10a779e1e4db9)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:38.673661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecc951-86ad-44d7-aa0c-6eb29b855afe None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:38.675257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 581/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:38 2022] GET /identity/v3/users/6c7385031bec484aa3f10a779e1e4db9 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:00:38.681093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59877d1a-5862-4022-928f-f8367ba82e19 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:38.780487 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59877d1a-5862-4022-928f-f8367ba82e19 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:38.813321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e608f6-9e89-439e-ad23-8d6f885c482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:38.813920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e608f6-9e89-439e-ad23-8d6f885c482e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:38.814203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e608f6-9e89-439e-ad23-8d6f885c482e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:38.814591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e608f6-9e89-439e-ad23-8d6f885c482e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:38.852185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:38.881203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e608f6-9e89-439e-ad23-8d6f885c482e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:38.882563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e608f6-9e89-439e-ad23-8d6f885c482e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:38.979213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 563/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:38.985686 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecc951-86ad-44d7-aa0c-6eb29b855afe None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:39.083242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecc951-86ad-44d7-aa0c-6eb29b855afe None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:39.116093 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abec3d6-8a40-4695-9f2b-6b00adcbaa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:39.116727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abec3d6-8a40-4695-9f2b-6b00adcbaa39 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:39.117008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abec3d6-8a40-4695-9f2b-6b00adcbaa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:39.117757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abec3d6-8a40-4695-9f2b-6b00adcbaa39 None admin] PATH_INFO: `/v3/projects/344dbc9b40094279b83cc14fd1650d3a` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:39.118530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abec3d6-8a40-4695-9f2b-6b00adcbaa39 None admin] RBAC: Authorizing `identity:get_project(project_id=344dbc9b40094279b83cc14fd1650d3a)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:39.119989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abec3d6-8a40-4695-9f2b-6b00adcbaa39 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:39.122187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 582/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:00:38 2022] GET /identity/v3/projects/344dbc9b40094279b83cc14fd1650d3a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:39.128358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e608f6-9e89-439e-ad23-8d6f885c482e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:39.194504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:39.223760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e608f6-9e89-439e-ad23-8d6f885c482e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:39.257410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126e8c3-1906-4376-a724-f3ca047175f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:39.258011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126e8c3-1906-4376-a724-f3ca047175f7 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:39.258310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126e8c3-1906-4376-a724-f3ca047175f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:39.258582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126e8c3-1906-4376-a724-f3ca047175f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:39.259307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126e8c3-1906-4376-a724-f3ca047175f7 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=344dbc9b40094279b83cc14fd1650d3a, user.id=6c7385031bec484aa3f10a779e1e4db9) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:39.259617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126e8c3-1906-4376-a724-f3ca047175f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:39.261067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126e8c3-1906-4376-a724-f3ca047175f7 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:39.266379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 564/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:00:39 2022] GET /identity/v3/role_assignments?user.id=6c7385031bec484aa3f10a779e1e4db9&scope.project.id=344dbc9b40094279b83cc14fd1650d3a&role.id=06592016669243d99b430c46dd1c1d46 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:41.415710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e4782-1e25-41b2-9c65-4188825ea28b None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:41.416775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e4782-1e25-41b2-9c65-4188825ea28b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:41.416775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e4782-1e25-41b2-9c65-4188825ea28b None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:41.417602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 583/1147] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:41.423019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157698-a2ee-4ea5-828c-56630dcbebfe None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:41.423644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157698-a2ee-4ea5-828c-56630dcbebfe None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:41.423644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157698-a2ee-4ea5-828c-56630dcbebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:41.441640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d3157698-a2ee-4ea5-828c-56630dcbebfe None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:41.442857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d3157698-a2ee-4ea5-828c-56630dcbebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:41.508911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 565/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:41.779769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e4782-1e25-41b2-9c65-4188825ea28b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:41.835419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:41.879655 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e4782-1e25-41b2-9c65-4188825ea28b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:41.912849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf8e38-e878-4468-9e20-954610b7d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:41.913475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf8e38-e878-4468-9e20-954610b7d414 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:41.913753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf8e38-e878-4468-9e20-954610b7d414 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:41.914037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf8e38-e878-4468-9e20-954610b7d414 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:41.924427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf8e38-e878-4468-9e20-954610b7d414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-38cf8e38-e878-4468-9e20-954610b7d414 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:00:41.929367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:41.930618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:41.931834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 584/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:41.937476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3157698-a2ee-4ea5-828c-56630dcbebfe None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:42.004950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:42.048945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3157698-a2ee-4ea5-828c-56630dcbebfe None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:42.083283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666c3dc-40fb-4805-a731-7e6cb06489d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:42.083921 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c3dc-40fb-4805-a731-7e6cb06489d8 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:42.084207 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c3dc-40fb-4805-a731-7e6cb06489d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:42.084481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c3dc-40fb-4805-a731-7e6cb06489d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:42.085146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666c3dc-40fb-4805-a731-7e6cb06489d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:42.085459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666c3dc-40fb-4805-a731-7e6cb06489d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:42.086823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666c3dc-40fb-4805-a731-7e6cb06489d8 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:42.094966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 566/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:00:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:42.100910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf8e38-e878-4468-9e20-954610b7d414 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:42.199326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf8e38-e878-4468-9e20-954610b7d414 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:42.214658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:42.231836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7d866-7591-431a-801c-13818bb92989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:42.232454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7d866-7591-431a-801c-13818bb92989 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:42.232728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7d866-7591-431a-801c-13818bb92989 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:42.232997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7d866-7591-431a-801c-13818bb92989 None admin] PATH_INFO: `/v3/users/6c7385031bec484aa3f10a779e1e4db9` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:42.234113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7d866-7591-431a-801c-13818bb92989 None admin] RBAC: Authorizing `identity:get_user(user_id=6c7385031bec484aa3f10a779e1e4db9)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:42.235517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7d866-7591-431a-801c-13818bb92989 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:42.237109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 585/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:42 2022] GET /identity/v3/users/6c7385031bec484aa3f10a779e1e4db9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:42.243787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666c3dc-40fb-4805-a731-7e6cb06489d8 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:42.345228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666c3dc-40fb-4805-a731-7e6cb06489d8 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:42.369991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:42.378502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330921-363c-4f17-8ec3-dd51286f8d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:42.379137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330921-363c-4f17-8ec3-dd51286f8d95 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:42.379697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330921-363c-4f17-8ec3-dd51286f8d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:42.379975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330921-363c-4f17-8ec3-dd51286f8d95 None admin] PATH_INFO: `/v3/projects/344dbc9b40094279b83cc14fd1650d3a` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:42.381097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330921-363c-4f17-8ec3-dd51286f8d95 None admin] RBAC: Authorizing `identity:get_project(project_id=344dbc9b40094279b83cc14fd1650d3a)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:42.382514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330921-363c-4f17-8ec3-dd51286f8d95 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:42.384224 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 567/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:00:42 2022] GET /identity/v3/projects/344dbc9b40094279b83cc14fd1650d3a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:42.390279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7d866-7591-431a-801c-13818bb92989 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:42.487293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7d866-7591-431a-801c-13818bb92989 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:42.519470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bd224-a4e1-4cfa-b2ab-ed3faeb5bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:42.520145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bd224-a4e1-4cfa-b2ab-ed3faeb5bc14 None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:42.520428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bd224-a4e1-4cfa-b2ab-ed3faeb5bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:42.520702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bd224-a4e1-4cfa-b2ab-ed3faeb5bc14 None admin] PATH_INFO: `/v3/projects/344dbc9b40094279b83cc14fd1650d3a/users/6c7385031bec484aa3f10a779e1e4db9/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:42.522584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bd224-a4e1-4cfa-b2ab-ed3faeb5bc14 None admin] RBAC: Authorizing `identity:create_grant(project_id=344dbc9b40094279b83cc14fd1650d3a, user_id=6c7385031bec484aa3f10a779e1e4db9, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:42.524040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bd224-a4e1-4cfa-b2ab-ed3faeb5bc14 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:42.606863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 586/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 12:00:42 2022] PUT /identity/v3/projects/344dbc9b40094279b83cc14fd1650d3a/users/6c7385031bec484aa3f10a779e1e4db9/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:00:44.775583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57d5e-3259-4094-8789-04e0c2d6a117 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:44.776212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57d5e-3259-4094-8789-04e0c2d6a117 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:44.776212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57d5e-3259-4094-8789-04e0c2d6a117 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:44.777506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 568/1154] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:44.783367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b837-1af5-4121-be3b-7e8c27b645ae None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:44.783838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b837-1af5-4121-be3b-7e8c27b645ae None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:44.783943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b837-1af5-4121-be3b-7e8c27b645ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:44.802086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-feb3b837-1af5-4121-be3b-7e8c27b645ae None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:44.803264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-feb3b837-1af5-4121-be3b-7e8c27b645ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:44.841570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:44.866924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 587/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:45.138406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57d5e-3259-4094-8789-04e0c2d6a117 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:45.238034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57d5e-3259-4094-8789-04e0c2d6a117 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:45.272391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca9c76-ae83-4cf7-bdf4-27f6fd058652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:45.273016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca9c76-ae83-4cf7-bdf4-27f6fd058652 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:45.273297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca9c76-ae83-4cf7-bdf4-27f6fd058652 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:45.273570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca9c76-ae83-4cf7-bdf4-27f6fd058652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:45.283926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca9c76-ae83-4cf7-bdf4-27f6fd058652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-2fca9c76-ae83-4cf7-bdf4-27f6fd058652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:00:45.288607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:45.289783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:00:45.290714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 569/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:45.296479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3b837-1af5-4121-be3b-7e8c27b645ae None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:45.389651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3b837-1af5-4121-be3b-7e8c27b645ae None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:45.421986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3359-fc7d-4186-b8f2-69bddde94635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:45.422578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3359-fc7d-4186-b8f2-69bddde94635 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:45.422852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3359-fc7d-4186-b8f2-69bddde94635 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:45.423120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3359-fc7d-4186-b8f2-69bddde94635 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:45.423798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c3359-fc7d-4186-b8f2-69bddde94635 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:45.424168 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c3359-fc7d-4186-b8f2-69bddde94635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:45.425436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c3359-fc7d-4186-b8f2-69bddde94635 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:45.433018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 588/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:45.439022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca9c76-ae83-4cf7-bdf4-27f6fd058652 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:45.495008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:45.538938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca9c76-ae83-4cf7-bdf4-27f6fd058652 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:45.577584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416198fa-bef9-42f0-80d8-8fa743dc2d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:45.578255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416198fa-bef9-42f0-80d8-8fa743dc2d95 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:45.578534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416198fa-bef9-42f0-80d8-8fa743dc2d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:45.578835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416198fa-bef9-42f0-80d8-8fa743dc2d95 None admin] PATH_INFO: `/v3/users/6c7385031bec484aa3f10a779e1e4db9` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:45.580072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416198fa-bef9-42f0-80d8-8fa743dc2d95 None admin] RBAC: Authorizing `identity:get_user(user_id=6c7385031bec484aa3f10a779e1e4db9)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:45.581949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416198fa-bef9-42f0-80d8-8fa743dc2d95 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:45.583835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 570/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:00:45 2022] GET /identity/v3/users/6c7385031bec484aa3f10a779e1e4db9 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:45.589641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3359-fc7d-4186-b8f2-69bddde94635 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:45.624200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:45.687722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3359-fc7d-4186-b8f2-69bddde94635 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:45.720920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b907166-11c6-4a3f-b7e2-91f0ddc34ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:45.721513 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b907166-11c6-4a3f-b7e2-91f0ddc34ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:45.721785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b907166-11c6-4a3f-b7e2-91f0ddc34ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:45.722055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b907166-11c6-4a3f-b7e2-91f0ddc34ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:45.786146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b907166-11c6-4a3f-b7e2-91f0ddc34ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:45.787562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b907166-11c6-4a3f-b7e2-91f0ddc34ee1 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:45.819036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:45.884054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 589/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:45.892151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416198fa-bef9-42f0-80d8-8fa743dc2d95 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:45.986694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416198fa-bef9-42f0-80d8-8fa743dc2d95 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:46.008205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:46.019358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49e15-cbf5-41da-b5ee-3c2a783195ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:46.020006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49e15-cbf5-41da-b5ee-3c2a783195ed None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:46.020279 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49e15-cbf5-41da-b5ee-3c2a783195ed None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:46.024472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49e15-cbf5-41da-b5ee-3c2a783195ed None admin] PATH_INFO: `/v3/projects/344dbc9b40094279b83cc14fd1650d3a` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:46.024472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49e15-cbf5-41da-b5ee-3c2a783195ed None admin] RBAC: Authorizing `identity:get_project(project_id=344dbc9b40094279b83cc14fd1650d3a)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:46.024472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49e15-cbf5-41da-b5ee-3c2a783195ed None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:46.024795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 571/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:00:45 2022] GET /identity/v3/projects/344dbc9b40094279b83cc14fd1650d3a => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:46.031321 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b907166-11c6-4a3f-b7e2-91f0ddc34ee1 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:46.135122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b907166-11c6-4a3f-b7e2-91f0ddc34ee1 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:46.169294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a2e8f-9eec-4ed3-9cc7-2f908af2628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:46.169906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a2e8f-9eec-4ed3-9cc7-2f908af2628b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:46.170181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a2e8f-9eec-4ed3-9cc7-2f908af2628b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:46.170453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a2e8f-9eec-4ed3-9cc7-2f908af2628b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:46.171170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a2e8f-9eec-4ed3-9cc7-2f908af2628b None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=344dbc9b40094279b83cc14fd1650d3a, user.id=6c7385031bec484aa3f10a779e1e4db9) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:46.171471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a2e8f-9eec-4ed3-9cc7-2f908af2628b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:46.172920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a2e8f-9eec-4ed3-9cc7-2f908af2628b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:46.175834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:46.178955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 590/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:00:46 2022] GET /identity/v3/role_assignments?user.id=6c7385031bec484aa3f10a779e1e4db9&scope.project.id=344dbc9b40094279b83cc14fd1650d3a&role.id=06592016669243d99b430c46dd1c1d46 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:48.352984 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f81a-e597-4b54-bf40-b815d400263a None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:48.353527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f81a-e597-4b54-bf40-b815d400263a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:48.353527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f81a-e597-4b54-bf40-b815d400263a None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:48.354863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 572/1162] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:48.360921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a081e1-68da-4b32-8170-c107c06ca9e0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:48.361315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a081e1-68da-4b32-8170-c107c06ca9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:48.361476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a081e1-68da-4b32-8170-c107c06ca9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:48.379517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-39a081e1-68da-4b32-8170-c107c06ca9e0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:48.380915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-39a081e1-68da-4b32-8170-c107c06ca9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:48.446311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 591/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:48.719872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f81a-e597-4b54-bf40-b815d400263a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:48.817740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f81a-e597-4b54-bf40-b815d400263a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:48.850245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bbcc6-b24c-4922-877e-8d71215b684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:48.850837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbcc6-b24c-4922-877e-8d71215b684c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:48.851115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbcc6-b24c-4922-877e-8d71215b684c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:48.851387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbcc6-b24c-4922-877e-8d71215b684c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:48.910560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:48.921189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bbcc6-b24c-4922-877e-8d71215b684c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:48.927551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bbcc6-b24c-4922-877e-8d71215b684c None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:49.017677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 573/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:00:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:49.023745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a081e1-68da-4b32-8170-c107c06ca9e0 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:49.120642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a081e1-68da-4b32-8170-c107c06ca9e0 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:49.148329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:49.154494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633571d-2374-4570-bcfc-05466d94a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:49.155127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633571d-2374-4570-bcfc-05466d94a09e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:49.155408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633571d-2374-4570-bcfc-05466d94a09e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:49.155714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633571d-2374-4570-bcfc-05466d94a09e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:49.162142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633571d-2374-4570-bcfc-05466d94a09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:49.163583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633571d-2374-4570-bcfc-05466d94a09e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0633571d-2374-4570-bcfc-05466d94a09e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:00:49.175842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:00:49.176950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:00:49.178230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 592/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 12:00:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:00:49.183136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bbcc6-b24c-4922-877e-8d71215b684c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:49.269250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:49.279337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bbcc6-b24c-4922-877e-8d71215b684c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:49.316196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c0165-45b3-4aae-a64c-99b1d8841a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:49.316978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c0165-45b3-4aae-a64c-99b1d8841a2d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:49.317308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c0165-45b3-4aae-a64c-99b1d8841a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:49.317772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c0165-45b3-4aae-a64c-99b1d8841a2d None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:49.318787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c0165-45b3-4aae-a64c-99b1d8841a2d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:00:49.319097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c0165-45b3-4aae-a64c-99b1d8841a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:49.320496 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c0165-45b3-4aae-a64c-99b1d8841a2d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:49.327681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 574/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 12:00:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:51.465427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a126492-b656-4a27-b931-25cd2d1718ff None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:51.465952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a126492-b656-4a27-b931-25cd2d1718ff None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:51.465952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a126492-b656-4a27-b931-25cd2d1718ff None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:51.467243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 593/1167] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:51.472795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0cd76-e7db-46b2-9b50-43efe3b4c740 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:51.473205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0cd76-e7db-46b2-9b50-43efe3b4c740 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:51.473354 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0cd76-e7db-46b2-9b50-43efe3b4c740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:51.491306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e8a0cd76-e7db-46b2-9b50-43efe3b4c740 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:51.492529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e8a0cd76-e7db-46b2-9b50-43efe3b4c740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:51.556420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 575/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:51.825718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a126492-b656-4a27-b931-25cd2d1718ff None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:51.925046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a126492-b656-4a27-b931-25cd2d1718ff None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:51.957941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984d0b5-a395-4e4d-9f92-e5c764cd37a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:51.958545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984d0b5-a395-4e4d-9f92-e5c764cd37a8 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:51.958828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984d0b5-a395-4e4d-9f92-e5c764cd37a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:51.959101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984d0b5-a395-4e4d-9f92-e5c764cd37a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:51.959800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984d0b5-a395-4e4d-9f92-e5c764cd37a8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:51.961161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984d0b5-a395-4e4d-9f92-e5c764cd37a8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:52.037401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 594/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Fri Sep 9 12:00:51 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:00:54.218261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5a9c0-a948-434c-b1c9-9fd6a553bee7 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:54.218783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5a9c0-a948-434c-b1c9-9fd6a553bee7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:54.218783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5a9c0-a948-434c-b1c9-9fd6a553bee7 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:54.220139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 576/1170] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:54.225414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025633bf-e510-41ac-9b49-04c9939476f2 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:54.225850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025633bf-e510-41ac-9b49-04c9939476f2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:54.225953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025633bf-e510-41ac-9b49-04c9939476f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:54.244179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-025633bf-e510-41ac-9b49-04c9939476f2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:54.245365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-025633bf-e510-41ac-9b49-04c9939476f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:54.289703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:54.310173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 595/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:54.581994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5a9c0-a948-434c-b1c9-9fd6a553bee7 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:54.664629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:54.680876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5a9c0-a948-434c-b1c9-9fd6a553bee7 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:54.714341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba6100-575f-4fe5-802b-c618d63d9e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:54.714971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6100-575f-4fe5-802b-c618d63d9e93 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:54.715255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6100-575f-4fe5-802b-c618d63d9e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:54.715532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6100-575f-4fe5-802b-c618d63d9e93 None admin] PATH_INFO: `/v3/domains/c79a8dafedf54500a2845b973cdcfd35` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:54.726201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba6100-575f-4fe5-802b-c618d63d9e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c79a8dafedf54500a2845b973cdcfd35)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:54.727674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba6100-575f-4fe5-802b-c618d63d9e93 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:54.729235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 577/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Sep 9 12:00:54 2022] GET /identity/v3/domains/c79a8dafedf54500a2845b973cdcfd35 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:54.735093 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025633bf-e510-41ac-9b49-04c9939476f2 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:54.829259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025633bf-e510-41ac-9b49-04c9939476f2 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:54.861729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75acdc-5ae7-4ea2-877f-6d7f65f78179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:54.862264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75acdc-5ae7-4ea2-877f-6d7f65f78179 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:54.862548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75acdc-5ae7-4ea2-877f-6d7f65f78179 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:54.862825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75acdc-5ae7-4ea2-877f-6d7f65f78179 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:54.863482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75acdc-5ae7-4ea2-877f-6d7f65f78179 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:54.864929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75acdc-5ae7-4ea2-877f-6d7f65f78179 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:54.958246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 596/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 12:00:54 2022] POST /identity/v3/projects => generated 361 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:00:57.158213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163975c6-a6a7-4f1a-9507-14a5bdda6d9f None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:57.158685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163975c6-a6a7-4f1a-9507-14a5bdda6d9f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:57.158820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163975c6-a6a7-4f1a-9507-14a5bdda6d9f None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:57.160181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 578/1174] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:00:57.165326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274d229-fa54-40eb-bb55-35583a9384fa None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:57.165757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274d229-fa54-40eb-bb55-35583a9384fa None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:57.165875 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274d229-fa54-40eb-bb55-35583a9384fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:57.183502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2274d229-fa54-40eb-bb55-35583a9384fa None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:57.184695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2274d229-fa54-40eb-bb55-35583a9384fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:57.209341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:57.249205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 597/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:00:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:00:57.523090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163975c6-a6a7-4f1a-9507-14a5bdda6d9f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:57.620009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163975c6-a6a7-4f1a-9507-14a5bdda6d9f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:57.653414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb21492-696c-4710-85f8-657fe4ffb211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:57.654125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21492-696c-4710-85f8-657fe4ffb211 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:57.654538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21492-696c-4710-85f8-657fe4ffb211 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:57.654961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21492-696c-4710-85f8-657fe4ffb211 None admin] PATH_INFO: `/v3/domains/c79a8dafedf54500a2845b973cdcfd35` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:57.656642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb21492-696c-4710-85f8-657fe4ffb211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c79a8dafedf54500a2845b973cdcfd35)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:57.658856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb21492-696c-4710-85f8-657fe4ffb211 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:57.661447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 579/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Sep 9 12:00:57 2022] GET /identity/v3/domains/c79a8dafedf54500a2845b973cdcfd35 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:00:57.667935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274d229-fa54-40eb-bb55-35583a9384fa None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:57.764678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274d229-fa54-40eb-bb55-35583a9384fa None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:57.796526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d2ba0-99b7-4f28-b7d3-70ea70062f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:57.797062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d2ba0-99b7-4f28-b7d3-70ea70062f41 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:57.797340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d2ba0-99b7-4f28-b7d3-70ea70062f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:57.797612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d2ba0-99b7-4f28-b7d3-70ea70062f41 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:57.798267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d2ba0-99b7-4f28-b7d3-70ea70062f41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:57.799707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d2ba0-99b7-4f28-b7d3-70ea70062f41 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:57.894702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 598/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 12:00:57 2022] POST /identity/v3/users => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:01:00.103953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802930-65ef-4d80-8956-3025f6fad07f None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:00.104489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802930-65ef-4d80-8956-3025f6fad07f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:00.104489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802930-65ef-4d80-8956-3025f6fad07f None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:00.105820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 580/1178] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:01:00.111569 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e27071-55f4-405d-b252-4eefba8db280 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:00.112018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e27071-55f4-405d-b252-4eefba8db280 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:00.112142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e27071-55f4-405d-b252-4eefba8db280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:00.136549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-93e27071-55f4-405d-b252-4eefba8db280 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:01:00.137754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-93e27071-55f4-405d-b252-4eefba8db280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:01:00.150820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:00.202864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 599/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:01:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 12:01:00.468538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802930-65ef-4d80-8956-3025f6fad07f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:00.483715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:00.567993 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802930-65ef-4d80-8956-3025f6fad07f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:00.601713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e966bd-ceec-4b68-beb7-7693271e596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:00.602417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e966bd-ceec-4b68-beb7-7693271e596c None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:00.602702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e966bd-ceec-4b68-beb7-7693271e596c None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:00.602978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e966bd-ceec-4b68-beb7-7693271e596c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:00.613628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e966bd-ceec-4b68-beb7-7693271e596c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-55e966bd-ceec-4b68-beb7-7693271e596c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:01:00.618317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:01:00.619309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:01:00.620205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 581/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:01:00.625596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e27071-55f4-405d-b252-4eefba8db280 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:00.721459 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e27071-55f4-405d-b252-4eefba8db280 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:00.753316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0636fa-ec14-4ce5-8771-b71879adc56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:00.753919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0636fa-ec14-4ce5-8771-b71879adc56f None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:00.754203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0636fa-ec14-4ce5-8771-b71879adc56f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:00.754479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0636fa-ec14-4ce5-8771-b71879adc56f None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:00.755140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0636fa-ec14-4ce5-8771-b71879adc56f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:01:00.755737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0636fa-ec14-4ce5-8771-b71879adc56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:00.757094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0636fa-ec14-4ce5-8771-b71879adc56f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:00.765527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 600/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:00.771465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e966bd-ceec-4b68-beb7-7693271e596c None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:00.840171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:00.868672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e966bd-ceec-4b68-beb7-7693271e596c None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:00.902947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c895de-447f-40aa-afa2-3d928821cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:00.904162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c895de-447f-40aa-afa2-3d928821cd79 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:00.904445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c895de-447f-40aa-afa2-3d928821cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:00.904719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c895de-447f-40aa-afa2-3d928821cd79 None admin] PATH_INFO: `/v3/users/7470800f13c74bc2bbe1156818b4921c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:00.917554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c895de-447f-40aa-afa2-3d928821cd79 None admin] RBAC: Authorizing `identity:get_user(user_id=7470800f13c74bc2bbe1156818b4921c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:00.919016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c895de-447f-40aa-afa2-3d928821cd79 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:00.920711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 582/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:01:00 2022] GET /identity/v3/users/7470800f13c74bc2bbe1156818b4921c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:00.926498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0636fa-ec14-4ce5-8771-b71879adc56f None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:00.938846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:01.024605 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0636fa-ec14-4ce5-8771-b71879adc56f None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:01.057461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d8f41-9e43-46b7-a9f9-8147628ef149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:01.058062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d8f41-9e43-46b7-a9f9-8147628ef149 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:01.058345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d8f41-9e43-46b7-a9f9-8147628ef149 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:01.058620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d8f41-9e43-46b7-a9f9-8147628ef149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:01.124519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d8f41-9e43-46b7-a9f9-8147628ef149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:01.125959 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d8f41-9e43-46b7-a9f9-8147628ef149 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:01.137002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:01.219573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 601/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:01:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:01:01.225798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c895de-447f-40aa-afa2-3d928821cd79 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:01.330051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c895de-447f-40aa-afa2-3d928821cd79 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:01.357506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:01.363141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b58ce-10aa-4671-a6b1-3dcc530aaedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:01.363800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b58ce-10aa-4671-a6b1-3dcc530aaedb None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:01.368214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b58ce-10aa-4671-a6b1-3dcc530aaedb None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:01.368214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b58ce-10aa-4671-a6b1-3dcc530aaedb None admin] PATH_INFO: `/v3/projects/926e465d02b640dcbe895111067b1033` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:01.368214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b58ce-10aa-4671-a6b1-3dcc530aaedb None admin] RBAC: Authorizing `identity:get_project(project_id=926e465d02b640dcbe895111067b1033)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:01.368214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b58ce-10aa-4671-a6b1-3dcc530aaedb None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:01.368569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 583/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:01:01 2022] GET /identity/v3/projects/926e465d02b640dcbe895111067b1033 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:01:01.375506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d8f41-9e43-46b7-a9f9-8147628ef149 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:01.471034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d8f41-9e43-46b7-a9f9-8147628ef149 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:01.481469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:01.504848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3807c9-25a5-4c76-9e0a-01d2a67b9f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:01.505712 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3807c9-25a5-4c76-9e0a-01d2a67b9f82 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:01.505989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3807c9-25a5-4c76-9e0a-01d2a67b9f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:01.506328 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3807c9-25a5-4c76-9e0a-01d2a67b9f82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:01.506985 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3807c9-25a5-4c76-9e0a-01d2a67b9f82 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=926e465d02b640dcbe895111067b1033, user.id=7470800f13c74bc2bbe1156818b4921c) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:01:01.507297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3807c9-25a5-4c76-9e0a-01d2a67b9f82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:01.509703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3807c9-25a5-4c76-9e0a-01d2a67b9f82 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:01.514922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 602/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:01:01 2022] GET /identity/v3/role_assignments?user.id=7470800f13c74bc2bbe1156818b4921c&scope.project.id=926e465d02b640dcbe895111067b1033&role.id=06592016669243d99b430c46dd1c1d46 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:03.645687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb143ea-ac09-4d18-a7c7-ac4a4eb9ffed None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:03.646218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb143ea-ac09-4d18-a7c7-ac4a4eb9ffed None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:03.646218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb143ea-ac09-4d18-a7c7-ac4a4eb9ffed None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:03.647617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 584/1186] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:01:03.652982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19d76-41eb-4841-80ec-cc7f9ea3e422 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:03.653439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19d76-41eb-4841-80ec-cc7f9ea3e422 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:03.653556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19d76-41eb-4841-80ec-cc7f9ea3e422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:03.671607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-dbe19d76-41eb-4841-80ec-cc7f9ea3e422 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:01:03.672809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-dbe19d76-41eb-4841-80ec-cc7f9ea3e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:01:03.736356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 603/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:01:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:01:04.007691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb143ea-ac09-4d18-a7c7-ac4a4eb9ffed None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:04.107996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb143ea-ac09-4d18-a7c7-ac4a4eb9ffed None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:04.142893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdc95b-cf37-497c-a470-e4f7a78c9ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:04.143525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc95b-cf37-497c-a470-e4f7a78c9ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:04.143837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc95b-cf37-497c-a470-e4f7a78c9ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:04.144114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc95b-cf37-497c-a470-e4f7a78c9ff5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:04.159850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdc95b-cf37-497c-a470-e4f7a78c9ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4acdc95b-cf37-497c-a470-e4f7a78c9ff5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:01:04.164604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:01:04.166614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:01:04.168497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 585/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:01:04.172015 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe19d76-41eb-4841-80ec-cc7f9ea3e422 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:04.267603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe19d76-41eb-4841-80ec-cc7f9ea3e422 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:04.269795 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:04.299294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e639a-c067-4418-a5be-adb3b4995638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:04.299931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e639a-c067-4418-a5be-adb3b4995638 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:04.300209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e639a-c067-4418-a5be-adb3b4995638 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:04.300485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e639a-c067-4418-a5be-adb3b4995638 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:04.301143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e639a-c067-4418-a5be-adb3b4995638 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:01:04.301450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e639a-c067-4418-a5be-adb3b4995638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:04.302801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e639a-c067-4418-a5be-adb3b4995638 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:04.311489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 604/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:01:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:04.317526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdc95b-cf37-497c-a470-e4f7a78c9ff5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:04.375842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:04.417152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdc95b-cf37-497c-a470-e4f7a78c9ff5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:04.451034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd4a2-0e82-4b0b-a642-e3752d3929b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:04.451686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd4a2-0e82-4b0b-a642-e3752d3929b5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:04.451968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd4a2-0e82-4b0b-a642-e3752d3929b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:04.452242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd4a2-0e82-4b0b-a642-e3752d3929b5 None admin] PATH_INFO: `/v3/users/7470800f13c74bc2bbe1156818b4921c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:04.453428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cd4a2-0e82-4b0b-a642-e3752d3929b5 None admin] RBAC: Authorizing `identity:get_user(user_id=7470800f13c74bc2bbe1156818b4921c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:04.454860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cd4a2-0e82-4b0b-a642-e3752d3929b5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:04.456457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 586/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:01:04 2022] GET /identity/v3/users/7470800f13c74bc2bbe1156818b4921c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:04.462415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e639a-c067-4418-a5be-adb3b4995638 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:04.558075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e639a-c067-4418-a5be-adb3b4995638 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:04.589714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced8aa7-2371-4ae2-97c4-52d2f46f2cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:04.590324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced8aa7-2371-4ae2-97c4-52d2f46f2cad None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:04.590603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced8aa7-2371-4ae2-97c4-52d2f46f2cad None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:04.590877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced8aa7-2371-4ae2-97c4-52d2f46f2cad None admin] PATH_INFO: `/v3/projects/926e465d02b640dcbe895111067b1033` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:04.592545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced8aa7-2371-4ae2-97c4-52d2f46f2cad None admin] RBAC: Authorizing `identity:get_project(project_id=926e465d02b640dcbe895111067b1033)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:04.593965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced8aa7-2371-4ae2-97c4-52d2f46f2cad None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:04.595573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 605/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:01:04 2022] GET /identity/v3/projects/926e465d02b640dcbe895111067b1033 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:04.601601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd4a2-0e82-4b0b-a642-e3752d3929b5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:04.697287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd4a2-0e82-4b0b-a642-e3752d3929b5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:04.723091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:04.731523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295c412-d68f-4297-bdb7-940aea7df141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:04.737176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c412-d68f-4297-bdb7-940aea7df141 None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:04.737176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c412-d68f-4297-bdb7-940aea7df141 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:04.737176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c412-d68f-4297-bdb7-940aea7df141 None admin] PATH_INFO: `/v3/projects/926e465d02b640dcbe895111067b1033/users/7470800f13c74bc2bbe1156818b4921c/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:04.737176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295c412-d68f-4297-bdb7-940aea7df141 None admin] RBAC: Authorizing `identity:create_grant(project_id=926e465d02b640dcbe895111067b1033, user_id=7470800f13c74bc2bbe1156818b4921c, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:04.737176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295c412-d68f-4297-bdb7-940aea7df141 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:04.865025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 587/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 12:01:04 2022] PUT /identity/v3/projects/926e465d02b640dcbe895111067b1033/users/7470800f13c74bc2bbe1156818b4921c/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:01:07.002953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0641c-32d2-4a67-9388-6e2971029da0 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:07.003489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0641c-32d2-4a67-9388-6e2971029da0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:07.003598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0641c-32d2-4a67-9388-6e2971029da0 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:07.004924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 606/1193] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:01:07.010522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff95b5-9e84-4a92-8453-99c5b90cd6aa None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:07.010946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff95b5-9e84-4a92-8453-99c5b90cd6aa None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:07.011069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff95b5-9e84-4a92-8453-99c5b90cd6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:07.029424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-99ff95b5-9e84-4a92-8453-99c5b90cd6aa None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:01:07.030598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-99ff95b5-9e84-4a92-8453-99c5b90cd6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:01:07.099448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 588/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:01:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:01:07.374584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0641c-32d2-4a67-9388-6e2971029da0 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:07.409726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:07.475076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0641c-32d2-4a67-9388-6e2971029da0 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:07.509119 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32055d0-9986-4d27-87f8-dfc44884ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:07.509743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32055d0-9986-4d27-87f8-dfc44884ca88 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:07.510025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32055d0-9986-4d27-87f8-dfc44884ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:07.510300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32055d0-9986-4d27-87f8-dfc44884ca88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:07.519933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32055d0-9986-4d27-87f8-dfc44884ca88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-b32055d0-9986-4d27-87f8-dfc44884ca88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:01:07.524679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:01:07.525781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:01:07.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 607/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:01:07.531996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff95b5-9e84-4a92-8453-99c5b90cd6aa None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:07.630445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff95b5-9e84-4a92-8453-99c5b90cd6aa None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:07.646378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:07.663449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a941e-aeaf-4656-bc27-063bef55880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:07.664090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a941e-aeaf-4656-bc27-063bef55880b None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:07.664375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a941e-aeaf-4656-bc27-063bef55880b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:07.664649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a941e-aeaf-4656-bc27-063bef55880b None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:07.665309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a941e-aeaf-4656-bc27-063bef55880b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:01:07.665617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a941e-aeaf-4656-bc27-063bef55880b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:07.666977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a941e-aeaf-4656-bc27-063bef55880b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:07.675891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 589/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:01:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:07.682007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32055d0-9986-4d27-87f8-dfc44884ca88 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:07.772564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:07.779487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32055d0-9986-4d27-87f8-dfc44884ca88 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:07.812080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedd04c-1522-4ab4-a265-f6ce815aac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:07.812692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedd04c-1522-4ab4-a265-f6ce815aac20 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:07.812968 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedd04c-1522-4ab4-a265-f6ce815aac20 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:07.813236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedd04c-1522-4ab4-a265-f6ce815aac20 None admin] PATH_INFO: `/v3/users/7470800f13c74bc2bbe1156818b4921c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:07.814340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedd04c-1522-4ab4-a265-f6ce815aac20 None admin] RBAC: Authorizing `identity:get_user(user_id=7470800f13c74bc2bbe1156818b4921c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:07.815785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedd04c-1522-4ab4-a265-f6ce815aac20 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:07.817344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 608/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 12:01:07 2022] GET /identity/v3/users/7470800f13c74bc2bbe1156818b4921c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:07.823147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a941e-aeaf-4656-bc27-063bef55880b None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:07.921478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a941e-aeaf-4656-bc27-063bef55880b None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:07.953425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb9797-5c72-47dd-bd2f-f815cc13e9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:07.954032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb9797-5c72-47dd-bd2f-f815cc13e9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:07.954314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb9797-5c72-47dd-bd2f-f815cc13e9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:07.954588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb9797-5c72-47dd-bd2f-f815cc13e9b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:08.003409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:08.024530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb9797-5c72-47dd-bd2f-f815cc13e9b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:08.025972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb9797-5c72-47dd-bd2f-f815cc13e9b0 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:08.128308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 590/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:01:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:01:08.134862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedd04c-1522-4ab4-a265-f6ce815aac20 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:08.247816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedd04c-1522-4ab4-a265-f6ce815aac20 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:08.287614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b496dd-15db-465d-9af8-8f852ef774ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:08.288264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b496dd-15db-465d-9af8-8f852ef774ee None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:08.288538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b496dd-15db-465d-9af8-8f852ef774ee None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:08.288805 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b496dd-15db-465d-9af8-8f852ef774ee None admin] PATH_INFO: `/v3/projects/926e465d02b640dcbe895111067b1033` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:08.289924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b496dd-15db-465d-9af8-8f852ef774ee None admin] RBAC: Authorizing `identity:get_project(project_id=926e465d02b640dcbe895111067b1033)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:08.291450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b496dd-15db-465d-9af8-8f852ef774ee None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:08.293304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 609/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 12:01:08 2022] GET /identity/v3/projects/926e465d02b640dcbe895111067b1033 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:08.299449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb9797-5c72-47dd-bd2f-f815cc13e9b0 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:01:08.383360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:08.407468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb9797-5c72-47dd-bd2f-f815cc13e9b0 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:01:08.447203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c7220-e655-4338-bae6-35eadb299651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:01:08.448012 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c7220-e655-4338-bae6-35eadb299651 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:01:08.448298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c7220-e655-4338-bae6-35eadb299651 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:01:08.448575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c7220-e655-4338-bae6-35eadb299651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:01:08.449304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c7220-e655-4338-bae6-35eadb299651 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=926e465d02b640dcbe895111067b1033, user.id=7470800f13c74bc2bbe1156818b4921c) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:01:08.449617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c7220-e655-4338-bae6-35eadb299651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:01:08.451590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c7220-e655-4338-bae6-35eadb299651 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:01:08.459290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 591/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:01:08 2022] GET /identity/v3/role_assignments?user.id=7470800f13c74bc2bbe1156818b4921c&scope.project.id=926e465d02b640dcbe895111067b1033&role.id=06592016669243d99b430c46dd1c1d46 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:01:18.281742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=85 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:18.454936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=29 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:21.650324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a51af-33b0-4085-815a-a7c8b8b0cdad None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:21.650937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a51af-33b0-4085-815a-a7c8b8b0cdad None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:21.650937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a51af-33b0-4085-815a-a7c8b8b0cdad None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:21.652421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 610/1201] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:02:21.657668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7460-4a83-4b95-acb8-7d012d16a436 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:21.658116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7460-4a83-4b95-acb8-7d012d16a436 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:21.658223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7460-4a83-4b95-acb8-7d012d16a436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:21.676758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-246b7460-4a83-4b95-acb8-7d012d16a436 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:21.680715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-246b7460-4a83-4b95-acb8-7d012d16a436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:21.743984 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 592/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:02:22.014184 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a51af-33b0-4085-815a-a7c8b8b0cdad None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:22.119375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a51af-33b0-4085-815a-a7c8b8b0cdad None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:22.153701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8d65a-e25a-4955-8c21-9040cd462c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:22.163535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8d65a-e25a-4955-8c21-9040cd462c53 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:22.163535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8d65a-e25a-4955-8c21-9040cd462c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:22.163535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8d65a-e25a-4955-8c21-9040cd462c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:22.165517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8d65a-e25a-4955-8c21-9040cd462c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:22.166994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8d65a-e25a-4955-8c21-9040cd462c53 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-2ca8d65a-e25a-4955-8c21-9040cd462c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:22.181971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:22.183284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:22.184695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:22.184695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:22.184695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:22.184695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 611/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:22.189274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b7460-4a83-4b95-acb8-7d012d16a436 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:22.287349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b7460-4a83-4b95-acb8-7d012d16a436 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:22.315164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:22.320833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83984da8-4f63-4297-b5f6-d07594fffdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:22.321432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83984da8-4f63-4297-b5f6-d07594fffdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:22.321716 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83984da8-4f63-4297-b5f6-d07594fffdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:22.321991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83984da8-4f63-4297-b5f6-d07594fffdb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:22.322629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83984da8-4f63-4297-b5f6-d07594fffdb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:22.322936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83984da8-4f63-4297-b5f6-d07594fffdb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:22.324328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83984da8-4f63-4297-b5f6-d07594fffdb2 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:22.335068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 593/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:22.341325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8d65a-e25a-4955-8c21-9040cd462c53 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:22.393748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:22.441835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8d65a-e25a-4955-8c21-9040cd462c53 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:22.476010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8f5a0-bc1b-4dab-8165-d89ed5cda15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:22.476621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8f5a0-bc1b-4dab-8165-d89ed5cda15a None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:22.476906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8f5a0-bc1b-4dab-8165-d89ed5cda15a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:22.477728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8f5a0-bc1b-4dab-8165-d89ed5cda15a None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:22.478395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8f5a0-bc1b-4dab-8165-d89ed5cda15a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:22.479833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8f5a0-bc1b-4dab-8165-d89ed5cda15a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:22.666173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 612/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 12:02:22 2022] POST /identity/v3/users => generated 251 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:02:24.867365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360906ef-9af5-4268-aaa8-eb3bdc58e263 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:24.867973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360906ef-9af5-4268-aaa8-eb3bdc58e263 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:24.867973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360906ef-9af5-4268-aaa8-eb3bdc58e263 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:24.869318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 594/1206] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:02:24.874735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85c420-df20-4e3f-8af7-41c213bb8b83 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:24.875125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85c420-df20-4e3f-8af7-41c213bb8b83 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:24.875292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85c420-df20-4e3f-8af7-41c213bb8b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:24.896136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8d85c420-df20-4e3f-8af7-41c213bb8b83 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:24.897326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8d85c420-df20-4e3f-8af7-41c213bb8b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:24.962830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 613/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:02:25.230637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360906ef-9af5-4268-aaa8-eb3bdc58e263 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:25.332160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360906ef-9af5-4268-aaa8-eb3bdc58e263 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:25.365953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297e750-972d-4c1f-a246-c5770b5f6735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:25.366586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297e750-972d-4c1f-a246-c5770b5f6735 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:25.366863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297e750-972d-4c1f-a246-c5770b5f6735 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:25.367132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297e750-972d-4c1f-a246-c5770b5f6735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:25.376995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297e750-972d-4c1f-a246-c5770b5f6735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-1297e750-972d-4c1f-a246-c5770b5f6735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:02:25.381641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:25.383690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:25.384660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 595/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 12:02:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:25.389118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85c420-df20-4e3f-8af7-41c213bb8b83 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:25.428207 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:25.485603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85c420-df20-4e3f-8af7-41c213bb8b83 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:25.521439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a47fc-cb1d-470d-8220-7fb7008837c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:25.522057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a47fc-cb1d-470d-8220-7fb7008837c6 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:25.522337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a47fc-cb1d-470d-8220-7fb7008837c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:25.522614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a47fc-cb1d-470d-8220-7fb7008837c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:25.523384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a47fc-cb1d-470d-8220-7fb7008837c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:25.523651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a47fc-cb1d-470d-8220-7fb7008837c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:25.531088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a47fc-cb1d-470d-8220-7fb7008837c6 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:25.533819 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 614/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 12:02:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:25.541400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297e750-972d-4c1f-a246-c5770b5f6735 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:25.595842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:25.644356 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297e750-972d-4c1f-a246-c5770b5f6735 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:25.679123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb5430-4013-45b0-bc30-2071d1366b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:25.679792 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb5430-4013-45b0-bc30-2071d1366b05 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:25.680076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb5430-4013-45b0-bc30-2071d1366b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:25.680351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb5430-4013-45b0-bc30-2071d1366b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:25.690574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb5430-4013-45b0-bc30-2071d1366b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:25.692050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb5430-4013-45b0-bc30-2071d1366b05 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-29fb5430-4013-45b0-bc30-2071d1366b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:25.706655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:25.707826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:25.708779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:25.708779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:25.708779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:25.708779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 596/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:25.714583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a47fc-cb1d-470d-8220-7fb7008837c6 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:25.813454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:25.816640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a47fc-cb1d-470d-8220-7fb7008837c6 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:25.849454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2af991-4603-423b-b4d3-703d4c58799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:25.850048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2af991-4603-423b-b4d3-703d4c58799c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:25.850320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2af991-4603-423b-b4d3-703d4c58799c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:25.850591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2af991-4603-423b-b4d3-703d4c58799c None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:25.851214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2af991-4603-423b-b4d3-703d4c58799c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:25.851508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2af991-4603-423b-b4d3-703d4c58799c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:25.852960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2af991-4603-423b-b4d3-703d4c58799c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:25.870413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 615/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:25.876210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb5430-4013-45b0-bc30-2071d1366b05 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:25.975880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb5430-4013-45b0-bc30-2071d1366b05 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:25.977431 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:26.010156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90574c94-1194-4fd5-ba47-5fa1c9fd7177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:26.011035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574c94-1194-4fd5-ba47-5fa1c9fd7177 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:26.011319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574c94-1194-4fd5-ba47-5fa1c9fd7177 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:26.011593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574c94-1194-4fd5-ba47-5fa1c9fd7177 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:26.018603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90574c94-1194-4fd5-ba47-5fa1c9fd7177 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:26.020078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90574c94-1194-4fd5-ba47-5fa1c9fd7177 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-90574c94-1194-4fd5-ba47-5fa1c9fd7177 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 12:02:26.032430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:26.033572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:26.034904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 597/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:26.039453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2af991-4603-423b-b4d3-703d4c58799c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:26.139796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2af991-4603-423b-b4d3-703d4c58799c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:26.172130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f135e-fcb1-46e4-b1fc-725fb016ca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:26.172770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f135e-fcb1-46e4-b1fc-725fb016ca10 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:26.173057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f135e-fcb1-46e4-b1fc-725fb016ca10 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:26.173335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f135e-fcb1-46e4-b1fc-725fb016ca10 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:26.174085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f135e-fcb1-46e4-b1fc-725fb016ca10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:26.174396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f135e-fcb1-46e4-b1fc-725fb016ca10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:26.177225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f135e-fcb1-46e4-b1fc-725fb016ca10 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:26.194101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 616/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 12:02:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:26.200777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90574c94-1194-4fd5-ba47-5fa1c9fd7177 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:26.300588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90574c94-1194-4fd5-ba47-5fa1c9fd7177 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:26.334728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891a0be-283e-46aa-a10a-45d497f876ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:26.335321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891a0be-283e-46aa-a10a-45d497f876ae None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:26.335606 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891a0be-283e-46aa-a10a-45d497f876ae None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:26.335913 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891a0be-283e-46aa-a10a-45d497f876ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:26.364856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:26.407545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891a0be-283e-46aa-a10a-45d497f876ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:26.408937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891a0be-283e-46aa-a10a-45d497f876ae None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:26.506085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 598/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:02:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:02:26.512430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f135e-fcb1-46e4-b1fc-725fb016ca10 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:26.531709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:26.608899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f135e-fcb1-46e4-b1fc-725fb016ca10 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:26.642834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880478ba-06a4-4149-9c3e-f55c95a6b1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:26.643458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880478ba-06a4-4149-9c3e-f55c95a6b1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:26.643772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880478ba-06a4-4149-9c3e-f55c95a6b1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:26.644049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880478ba-06a4-4149-9c3e-f55c95a6b1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:26.653755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880478ba-06a4-4149-9c3e-f55c95a6b1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:26.655190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880478ba-06a4-4149-9c3e-f55c95a6b1b5 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-880478ba-06a4-4149-9c3e-f55c95a6b1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:26.670062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:26.671172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:26.672166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:26.672166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:26.672166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:26.672166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 617/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:26.676942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891a0be-283e-46aa-a10a-45d497f876ae None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:26.738192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:26.778364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891a0be-283e-46aa-a10a-45d497f876ae None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:26.811997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9705c25-4108-4435-8de8-13b8187aa845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:26.812651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9705c25-4108-4435-8de8-13b8187aa845 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:26.812936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9705c25-4108-4435-8de8-13b8187aa845 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:26.813235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9705c25-4108-4435-8de8-13b8187aa845 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:26.813852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9705c25-4108-4435-8de8-13b8187aa845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:26.814163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9705c25-4108-4435-8de8-13b8187aa845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:26.815527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9705c25-4108-4435-8de8-13b8187aa845 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:26.827317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 599/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:26.833047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880478ba-06a4-4149-9c3e-f55c95a6b1b5 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:26.902136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:26.932485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880478ba-06a4-4149-9c3e-f55c95a6b1b5 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:26.965242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953dff-fd66-42c1-ad79-c72493d45596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:26.965869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953dff-fd66-42c1-ad79-c72493d45596 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:26.966152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953dff-fd66-42c1-ad79-c72493d45596 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:26.966474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953dff-fd66-42c1-ad79-c72493d45596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:26.972903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f953dff-fd66-42c1-ad79-c72493d45596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:26.974339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f953dff-fd66-42c1-ad79-c72493d45596 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-8f953dff-fd66-42c1-ad79-c72493d45596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 12:02:26.986774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:26.987955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:26.989036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 12:02:26.989036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 12:02:26.989036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:02:26.989036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:02:26.989036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:02:26.989036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:02:26.989036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:26.989036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:26.989036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 618/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:26.993964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9705c25-4108-4435-8de8-13b8187aa845 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:27.095595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9705c25-4108-4435-8de8-13b8187aa845 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:27.120943 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:27.132345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8941062-7e3a-4eea-8ddf-f40b7015cdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:27.132957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941062-7e3a-4eea-8ddf-f40b7015cdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:27.133240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941062-7e3a-4eea-8ddf-f40b7015cdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:27.134027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941062-7e3a-4eea-8ddf-f40b7015cdd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:27.134712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8941062-7e3a-4eea-8ddf-f40b7015cdd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:27.135022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8941062-7e3a-4eea-8ddf-f40b7015cdd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:27.136720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8941062-7e3a-4eea-8ddf-f40b7015cdd7 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:27.148024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 600/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 12:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:27.154643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953dff-fd66-42c1-ad79-c72493d45596 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:27.251868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953dff-fd66-42c1-ad79-c72493d45596 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:27.280273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:27.285874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52683a86-87e3-427a-9f15-7781d3c26a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:27.286476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52683a86-87e3-427a-9f15-7781d3c26a67 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:27.286753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52683a86-87e3-427a-9f15-7781d3c26a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:27.287025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52683a86-87e3-427a-9f15-7781d3c26a67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:27.287761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52683a86-87e3-427a-9f15-7781d3c26a67 None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=03a4b508dd7048df83f7beeacfe9c085) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:27.292120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52683a86-87e3-427a-9f15-7781d3c26a67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:27.292120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52683a86-87e3-427a-9f15-7781d3c26a67 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:27.294706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 619/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:02:27 2022] GET /identity/v3/role_assignments?user.id=03a4b508dd7048df83f7beeacfe9c085&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:29.444271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196ec3-aa23-465e-bf57-c710a48d5749 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:29.444781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196ec3-aa23-465e-bf57-c710a48d5749 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:29.444781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196ec3-aa23-465e-bf57-c710a48d5749 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:29.446078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 601/1220] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:02:29.452050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5322ef2-db5d-41fe-aea2-6f003dad429e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:29.452528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5322ef2-db5d-41fe-aea2-6f003dad429e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:29.452621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5322ef2-db5d-41fe-aea2-6f003dad429e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:29.471608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f5322ef2-db5d-41fe-aea2-6f003dad429e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:29.472861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f5322ef2-db5d-41fe-aea2-6f003dad429e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:29.538366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 620/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:02:29.809865 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54196ec3-aa23-465e-bf57-c710a48d5749 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:29.912226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54196ec3-aa23-465e-bf57-c710a48d5749 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:29.945892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deffe9-2c93-4266-8dc2-6bf40b9f6c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:29.947159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deffe9-2c93-4266-8dc2-6bf40b9f6c7a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:29.947436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deffe9-2c93-4266-8dc2-6bf40b9f6c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:29.947736 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deffe9-2c93-4266-8dc2-6bf40b9f6c7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:29.962037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53deffe9-2c93-4266-8dc2-6bf40b9f6c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-53deffe9-2c93-4266-8dc2-6bf40b9f6c7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:02:29.966751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:29.967862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:29.968726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 602/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 12:02:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:29.973987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5322ef2-db5d-41fe-aea2-6f003dad429e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:30.070639 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5322ef2-db5d-41fe-aea2-6f003dad429e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:30.094066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:30.104476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda49f0-d18a-46bb-a0f5-56870c13e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:30.105100 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda49f0-d18a-46bb-a0f5-56870c13e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:30.105369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda49f0-d18a-46bb-a0f5-56870c13e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:30.105643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda49f0-d18a-46bb-a0f5-56870c13e7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:30.106313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda49f0-d18a-46bb-a0f5-56870c13e7d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:30.106614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda49f0-d18a-46bb-a0f5-56870c13e7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:30.107994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda49f0-d18a-46bb-a0f5-56870c13e7d3 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:30.116998 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 621/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 12:02:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:30.123152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deffe9-2c93-4266-8dc2-6bf40b9f6c7a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:30.167385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:30.223916 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deffe9-2c93-4266-8dc2-6bf40b9f6c7a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:30.258120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a924-530a-4559-8354-794166eb4db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:30.259312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a924-530a-4559-8354-794166eb4db5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:30.259594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a924-530a-4559-8354-794166eb4db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:30.264384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a924-530a-4559-8354-794166eb4db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:30.270525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a924-530a-4559-8354-794166eb4db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:30.271991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a924-530a-4559-8354-794166eb4db5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-de55a924-530a-4559-8354-794166eb4db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:30.286386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:30.287403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:30.288401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:30.288401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:30.288401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:30.288401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 603/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:30.293430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda49f0-d18a-46bb-a0f5-56870c13e7d3 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:30.391723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda49f0-d18a-46bb-a0f5-56870c13e7d3 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:30.425551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2da09-459a-4e77-a9b6-21d94c84f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:30.426147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2da09-459a-4e77-a9b6-21d94c84f7fb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:30.426430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2da09-459a-4e77-a9b6-21d94c84f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:30.426706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2da09-459a-4e77-a9b6-21d94c84f7fb None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:30.427348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2da09-459a-4e77-a9b6-21d94c84f7fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:30.427678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2da09-459a-4e77-a9b6-21d94c84f7fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:30.429028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2da09-459a-4e77-a9b6-21d94c84f7fb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:30.440747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 622/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:30.447203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a924-530a-4559-8354-794166eb4db5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:30.544668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:30.551324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a924-530a-4559-8354-794166eb4db5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:30.585527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a703-f362-4f3f-8d62-fad269072c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:30.586210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a703-f362-4f3f-8d62-fad269072c8f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:30.586495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a703-f362-4f3f-8d62-fad269072c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:30.586772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a703-f362-4f3f-8d62-fad269072c8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:30.594395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9a703-f362-4f3f-8d62-fad269072c8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:30.595876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9a703-f362-4f3f-8d62-fad269072c8f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-71f9a703-f362-4f3f-8d62-fad269072c8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 12:02:30.607526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:30.608673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:30.609669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 604/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:30.614657 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2da09-459a-4e77-a9b6-21d94c84f7fb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:30.662057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:30.713271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2da09-459a-4e77-a9b6-21d94c84f7fb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:30.746835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b070de-3d34-4f4b-b1f5-79138bdea066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:30.747437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b070de-3d34-4f4b-b1f5-79138bdea066 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:30.747745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b070de-3d34-4f4b-b1f5-79138bdea066 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:30.748022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b070de-3d34-4f4b-b1f5-79138bdea066 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:30.748753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b070de-3d34-4f4b-b1f5-79138bdea066 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:30.749066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b070de-3d34-4f4b-b1f5-79138bdea066 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:30.750511 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b070de-3d34-4f4b-b1f5-79138bdea066 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:30.769055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 623/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 12:02:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:02:30.775096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a703-f362-4f3f-8d62-fad269072c8f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:30.874087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a703-f362-4f3f-8d62-fad269072c8f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:30.907775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4686bdc-661f-454d-b3cf-3749a687ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:30.908399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4686bdc-661f-454d-b3cf-3749a687ff1f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:30.908677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4686bdc-661f-454d-b3cf-3749a687ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:30.908947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4686bdc-661f-454d-b3cf-3749a687ff1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:30.919963 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4686bdc-661f-454d-b3cf-3749a687ff1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:30.921321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4686bdc-661f-454d-b3cf-3749a687ff1f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-a4686bdc-661f-454d-b3cf-3749a687ff1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:30.936028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:30.937223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:30.938195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:30.938195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:30.938195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:30.938195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 605/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:30.943045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b070de-3d34-4f4b-b1f5-79138bdea066 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:31.038356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b070de-3d34-4f4b-b1f5-79138bdea066 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:31.041148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:31.071529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba4c7c-a94e-4f17-915a-4e66cf0c3784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:31.072190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4c7c-a94e-4f17-915a-4e66cf0c3784 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:31.072470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4c7c-a94e-4f17-915a-4e66cf0c3784 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:31.072743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4c7c-a94e-4f17-915a-4e66cf0c3784 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:31.073378 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba4c7c-a94e-4f17-915a-4e66cf0c3784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:31.073680 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba4c7c-a94e-4f17-915a-4e66cf0c3784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:31.075022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba4c7c-a94e-4f17-915a-4e66cf0c3784 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:31.085958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 624/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:31.091761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4686bdc-661f-454d-b3cf-3749a687ff1f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:31.102039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:31.195087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4686bdc-661f-454d-b3cf-3749a687ff1f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:31.228743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622506-518c-4bc8-95dd-4c0e16a5fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:31.229956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622506-518c-4bc8-95dd-4c0e16a5fbbf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:31.230237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622506-518c-4bc8-95dd-4c0e16a5fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:31.230508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622506-518c-4bc8-95dd-4c0e16a5fbbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:31.237156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74622506-518c-4bc8-95dd-4c0e16a5fbbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:31.238567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74622506-518c-4bc8-95dd-4c0e16a5fbbf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-74622506-518c-4bc8-95dd-4c0e16a5fbbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 12:02:31.249399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:31.250488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:31.251607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 12:02:31.251607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 12:02:31.251607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:02:31.251607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:02:31.251607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:02:31.251607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:02:31.251607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:31.251607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:31.251607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 606/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:31.256481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba4c7c-a94e-4f17-915a-4e66cf0c3784 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:31.355613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba4c7c-a94e-4f17-915a-4e66cf0c3784 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:31.387606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525c6e8-90b0-444a-9937-5afc0af1be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:31.388235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c6e8-90b0-444a-9937-5afc0af1be9e None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:31.388515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c6e8-90b0-444a-9937-5afc0af1be9e None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:31.388791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c6e8-90b0-444a-9937-5afc0af1be9e None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:31.389470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525c6e8-90b0-444a-9937-5afc0af1be9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:31.389777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525c6e8-90b0-444a-9937-5afc0af1be9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:31.391182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525c6e8-90b0-444a-9937-5afc0af1be9e None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:31.403416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 625/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 12:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:31.409611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622506-518c-4bc8-95dd-4c0e16a5fbbf None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:31.476150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:31.510396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622506-518c-4bc8-95dd-4c0e16a5fbbf None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:31.544243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda580d-5636-4da8-864f-43e94c054efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:31.544973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda580d-5636-4da8-864f-43e94c054efa None admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:31.545522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda580d-5636-4da8-864f-43e94c054efa None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:31.545974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda580d-5636-4da8-864f-43e94c054efa None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/03a4b508dd7048df83f7beeacfe9c085/roles/73f84507c19147c0b7e3cdf8ac72e212` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:31.560799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda580d-5636-4da8-864f-43e94c054efa None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=03a4b508dd7048df83f7beeacfe9c085, role_id=73f84507c19147c0b7e3cdf8ac72e212)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:31.567201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda580d-5636-4da8-864f-43e94c054efa None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:31.654680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 607/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 12:02:31 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/03a4b508dd7048df83f7beeacfe9c085/roles/73f84507c19147c0b7e3cdf8ac72e212 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:02:33.835868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958a74a-ffb1-4ff9-b192-96da0ae4fabc None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:33.836454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958a74a-ffb1-4ff9-b192-96da0ae4fabc None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:33.836454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958a74a-ffb1-4ff9-b192-96da0ae4fabc None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:33.837807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 626/1233] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:02:33.844146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041147f-a943-4513-b079-531a64d92c75 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:33.844591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041147f-a943-4513-b079-531a64d92c75 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:33.844696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041147f-a943-4513-b079-531a64d92c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:33.864416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-5041147f-a943-4513-b079-531a64d92c75 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:33.865625 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5041147f-a943-4513-b079-531a64d92c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:33.933115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 608/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:02:34.207609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958a74a-ffb1-4ff9-b192-96da0ae4fabc None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:34.234009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:34.307885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958a74a-ffb1-4ff9-b192-96da0ae4fabc None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:34.341329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b93798-70c9-4bc7-a6c5-13df3d72d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:34.341949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93798-70c9-4bc7-a6c5-13df3d72d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:34.342224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93798-70c9-4bc7-a6c5-13df3d72d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:34.342497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93798-70c9-4bc7-a6c5-13df3d72d4d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:34.352193 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b93798-70c9-4bc7-a6c5-13df3d72d4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-a5b93798-70c9-4bc7-a6c5-13df3d72d4d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:02:34.357698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:34.358822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:34.360029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 627/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 12:02:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:34.364969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041147f-a943-4513-b079-531a64d92c75 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:34.411323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:34.465158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041147f-a943-4513-b079-531a64d92c75 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:34.499055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b033b-624d-45fd-9672-08688cf08e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:34.499717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b033b-624d-45fd-9672-08688cf08e09 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:34.499998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b033b-624d-45fd-9672-08688cf08e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:34.500268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b033b-624d-45fd-9672-08688cf08e09 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:34.500920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b033b-624d-45fd-9672-08688cf08e09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:34.501220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b033b-624d-45fd-9672-08688cf08e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:34.502613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b033b-624d-45fd-9672-08688cf08e09 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:34.510531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 609/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 12:02:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:34.516654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b93798-70c9-4bc7-a6c5-13df3d72d4d5 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:34.602693 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:34.617974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b93798-70c9-4bc7-a6c5-13df3d72d4d5 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:34.650956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebd0f0-8664-46b0-b601-f894e70239ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:34.652284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebd0f0-8664-46b0-b601-f894e70239ef None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:34.652561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebd0f0-8664-46b0-b601-f894e70239ef None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:34.652828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebd0f0-8664-46b0-b601-f894e70239ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:34.662322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebd0f0-8664-46b0-b601-f894e70239ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:34.663713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebd0f0-8664-46b0-b601-f894e70239ef None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-6bebd0f0-8664-46b0-b601-f894e70239ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:34.678141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:34.681763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:34.682987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:34.682987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:34.682987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:34.682987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 628/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:34.685140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b033b-624d-45fd-9672-08688cf08e09 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:34.785896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b033b-624d-45fd-9672-08688cf08e09 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:34.796726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:34.821920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928fadd-ac0a-41cf-b94b-645f29b6b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:34.822527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928fadd-ac0a-41cf-b94b-645f29b6b90e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:34.822808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928fadd-ac0a-41cf-b94b-645f29b6b90e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:34.823596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928fadd-ac0a-41cf-b94b-645f29b6b90e None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:34.824267 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928fadd-ac0a-41cf-b94b-645f29b6b90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:34.824573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928fadd-ac0a-41cf-b94b-645f29b6b90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:34.825939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928fadd-ac0a-41cf-b94b-645f29b6b90e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:34.839208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 610/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:34.845226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebd0f0-8664-46b0-b601-f894e70239ef None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:34.946967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebd0f0-8664-46b0-b601-f894e70239ef None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:34.981188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3374e-7ca8-44ab-83e0-3506ccfaf34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:34.981819 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3374e-7ca8-44ab-83e0-3506ccfaf34b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:34.982103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3374e-7ca8-44ab-83e0-3506ccfaf34b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:34.982382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3374e-7ca8-44ab-83e0-3506ccfaf34b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:34.985131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:34.990155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3374e-7ca8-44ab-83e0-3506ccfaf34b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:34.991655 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3374e-7ca8-44ab-83e0-3506ccfaf34b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-38a3374e-7ca8-44ab-83e0-3506ccfaf34b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 12:02:35.003272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:35.004458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:35.005534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 629/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:35.010451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928fadd-ac0a-41cf-b94b-645f29b6b90e None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:35.112433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928fadd-ac0a-41cf-b94b-645f29b6b90e None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:35.148347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a179-5e4d-49a4-a34e-9cd88d7b7a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:35.148959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a179-5e4d-49a4-a34e-9cd88d7b7a26 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:35.149240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a179-5e4d-49a4-a34e-9cd88d7b7a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:35.149514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a179-5e4d-49a4-a34e-9cd88d7b7a26 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:35.150242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a179-5e4d-49a4-a34e-9cd88d7b7a26 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:35.150545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a179-5e4d-49a4-a34e-9cd88d7b7a26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:35.152023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a179-5e4d-49a4-a34e-9cd88d7b7a26 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:35.169629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 611/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 12:02:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:35.175484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3374e-7ca8-44ab-83e0-3506ccfaf34b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:35.277686 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3374e-7ca8-44ab-83e0-3506ccfaf34b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:35.310849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3563d6-0942-4bc0-92d2-bf43d3ae2464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:35.311497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3563d6-0942-4bc0-92d2-bf43d3ae2464 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:35.311808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3563d6-0942-4bc0-92d2-bf43d3ae2464 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:35.312101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3563d6-0942-4bc0-92d2-bf43d3ae2464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:35.372669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:35.379999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3563d6-0942-4bc0-92d2-bf43d3ae2464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:35.381455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3563d6-0942-4bc0-92d2-bf43d3ae2464 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:35.482143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 630/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:02:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:02:35.488453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a179-5e4d-49a4-a34e-9cd88d7b7a26 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:35.517897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:35.599975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a179-5e4d-49a4-a34e-9cd88d7b7a26 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:35.635975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7e730-c3ce-4180-99cb-a6aa23694aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:35.636879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7e730-c3ce-4180-99cb-a6aa23694aee None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:35.637156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7e730-c3ce-4180-99cb-a6aa23694aee None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:35.637429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7e730-c3ce-4180-99cb-a6aa23694aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:35.647506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7e730-c3ce-4180-99cb-a6aa23694aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:35.648986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7e730-c3ce-4180-99cb-a6aa23694aee None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-16a7e730-c3ce-4180-99cb-a6aa23694aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:35.663505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:35.664936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:35.666076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:35.666076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:35.666076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:35.666076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 612/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:35.671286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3563d6-0942-4bc0-92d2-bf43d3ae2464 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:35.764867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:35.770519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3563d6-0942-4bc0-92d2-bf43d3ae2464 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:35.804326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab706c-a1be-4a3a-a352-808a6eb627b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:35.804930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab706c-a1be-4a3a-a352-808a6eb627b8 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:35.805208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab706c-a1be-4a3a-a352-808a6eb627b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:35.805479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab706c-a1be-4a3a-a352-808a6eb627b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:35.806110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab706c-a1be-4a3a-a352-808a6eb627b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:35.806410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab706c-a1be-4a3a-a352-808a6eb627b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:35.807793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab706c-a1be-4a3a-a352-808a6eb627b8 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:35.818784 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 631/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:35.824561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7e730-c3ce-4180-99cb-a6aa23694aee None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:35.908031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:35.933762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7e730-c3ce-4180-99cb-a6aa23694aee None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:35.967390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a1a69-423e-4940-b14e-509b4237d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:35.968046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a1a69-423e-4940-b14e-509b4237d04a None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:35.968329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a1a69-423e-4940-b14e-509b4237d04a None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:35.968601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a1a69-423e-4940-b14e-509b4237d04a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:35.975014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a1a69-423e-4940-b14e-509b4237d04a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:35.976466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a1a69-423e-4940-b14e-509b4237d04a None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-397a1a69-423e-4940-b14e-509b4237d04a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 12:02:35.988026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:35.990269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:35.991350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 12:02:35.991350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 12:02:35.991350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:02:35.991350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:02:35.991350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:02:35.991350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:02:35.991350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:35.991350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:35.991350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 613/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:02:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:35.995092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab706c-a1be-4a3a-a352-808a6eb627b8 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:36.099392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab706c-a1be-4a3a-a352-808a6eb627b8 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:36.133902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fb623-d083-40b1-b0b5-0c352b0337ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:36.134510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fb623-d083-40b1-b0b5-0c352b0337ea None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:36.134782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fb623-d083-40b1-b0b5-0c352b0337ea None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:36.135051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fb623-d083-40b1-b0b5-0c352b0337ea None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:36.136584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fb623-d083-40b1-b0b5-0c352b0337ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:36.136887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fb623-d083-40b1-b0b5-0c352b0337ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:36.138306 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fb623-d083-40b1-b0b5-0c352b0337ea None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:36.150569 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 632/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 12:02:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:36.157392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a1a69-423e-4940-b14e-509b4237d04a None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:36.257777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a1a69-423e-4940-b14e-509b4237d04a None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:36.291980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68bbd7-5f17-48e6-803d-9d6141712faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:36.292585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68bbd7-5f17-48e6-803d-9d6141712faf None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:36.293036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68bbd7-5f17-48e6-803d-9d6141712faf None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:36.293130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68bbd7-5f17-48e6-803d-9d6141712faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:36.293835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68bbd7-5f17-48e6-803d-9d6141712faf None admin] RBAC: Adding query filter params (role.id=73f84507c19147c0b7e3cdf8ac72e212, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=03a4b508dd7048df83f7beeacfe9c085) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:36.294149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68bbd7-5f17-48e6-803d-9d6141712faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:36.295572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68bbd7-5f17-48e6-803d-9d6141712faf None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:36.301260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 614/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:02:36 2022] GET /identity/v3/role_assignments?user.id=03a4b508dd7048df83f7beeacfe9c085&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=73f84507c19147c0b7e3cdf8ac72e212 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:38.526082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7e9f9-b5d9-4daa-90f5-eed2fa05561b None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:38.526586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7e9f9-b5d9-4daa-90f5-eed2fa05561b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:38.526586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7e9f9-b5d9-4daa-90f5-eed2fa05561b None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:38.528113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 633/1247] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:02:38.533604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281c9a0-43b3-4047-819e-55398ac130b2 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:38.534039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281c9a0-43b3-4047-819e-55398ac130b2 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:38.534149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281c9a0-43b3-4047-819e-55398ac130b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:38.540486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:38.553828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-1281c9a0-43b3-4047-819e-55398ac130b2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:38.555011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-1281c9a0-43b3-4047-819e-55398ac130b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:38.625371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 615/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:02:38.892630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7e9f9-b5d9-4daa-90f5-eed2fa05561b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:38.910724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:38.992966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7e9f9-b5d9-4daa-90f5-eed2fa05561b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:39.025920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00779d-0c69-4361-b8a2-a944e5ecbfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:39.027048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00779d-0c69-4361-b8a2-a944e5ecbfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:39.027324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00779d-0c69-4361-b8a2-a944e5ecbfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:39.027599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00779d-0c69-4361-b8a2-a944e5ecbfd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:39.037582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00779d-0c69-4361-b8a2-a944e5ecbfd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-fa00779d-0c69-4361-b8a2-a944e5ecbfd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:02:39.042950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:39.044111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:39.045191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 634/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:39.050133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281c9a0-43b3-4047-819e-55398ac130b2 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:39.150324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281c9a0-43b3-4047-819e-55398ac130b2 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:39.179995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:39.185271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e79723-1bf9-4f87-9890-dc82ed6ed479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:39.185877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e79723-1bf9-4f87-9890-dc82ed6ed479 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:39.186157 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e79723-1bf9-4f87-9890-dc82ed6ed479 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:39.186479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e79723-1bf9-4f87-9890-dc82ed6ed479 None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:39.187165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e79723-1bf9-4f87-9890-dc82ed6ed479 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:39.187470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e79723-1bf9-4f87-9890-dc82ed6ed479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:39.188862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e79723-1bf9-4f87-9890-dc82ed6ed479 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:39.196787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 616/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:02:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:39.203423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00779d-0c69-4361-b8a2-a944e5ecbfd5 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:39.280058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:39.302988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00779d-0c69-4361-b8a2-a944e5ecbfd5 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:39.337498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132c2e8-8fe6-4109-bc53-eee93855e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:39.338119 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132c2e8-8fe6-4109-bc53-eee93855e0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:39.338394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132c2e8-8fe6-4109-bc53-eee93855e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:39.338663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132c2e8-8fe6-4109-bc53-eee93855e0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:39.348911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132c2e8-8fe6-4109-bc53-eee93855e0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:39.350337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132c2e8-8fe6-4109-bc53-eee93855e0e1 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-2132c2e8-8fe6-4109-bc53-eee93855e0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:39.364108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:39.365240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:39.366163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:39.366163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:39.366163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:39.366163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 635/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:39.371195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e79723-1bf9-4f87-9890-dc82ed6ed479 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:39.474581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e79723-1bf9-4f87-9890-dc82ed6ed479 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:39.508765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c731b89-1b2b-4cf0-b909-bbf118c0c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:39.509367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c731b89-1b2b-4cf0-b909-bbf118c0c6ec None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:39.509650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c731b89-1b2b-4cf0-b909-bbf118c0c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:39.509927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c731b89-1b2b-4cf0-b909-bbf118c0c6ec None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:39.510607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c731b89-1b2b-4cf0-b909-bbf118c0c6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:39.511810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c731b89-1b2b-4cf0-b909-bbf118c0c6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:39.513168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c731b89-1b2b-4cf0-b909-bbf118c0c6ec None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:39.524911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 617/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:39.530695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132c2e8-8fe6-4109-bc53-eee93855e0e1 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:39.631761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132c2e8-8fe6-4109-bc53-eee93855e0e1 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:39.657415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:39.665014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ee246-5aa3-4577-9970-07b92de91831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:39.665638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ee246-5aa3-4577-9970-07b92de91831 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:39.665924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ee246-5aa3-4577-9970-07b92de91831 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:39.666201 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ee246-5aa3-4577-9970-07b92de91831 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:39.673270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ee246-5aa3-4577-9970-07b92de91831 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:39.674684 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ee246-5aa3-4577-9970-07b92de91831 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-a78ee246-5aa3-4577-9970-07b92de91831 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 12:02:39.685948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:39.690534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:39.691733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 636/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:39.693068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c731b89-1b2b-4cf0-b909-bbf118c0c6ec None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:39.749690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:39.794596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c731b89-1b2b-4cf0-b909-bbf118c0c6ec None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:39.828081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a080c3-bc69-4aa9-8664-e96ee58512e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:39.828681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a080c3-bc69-4aa9-8664-e96ee58512e3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:39.828964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a080c3-bc69-4aa9-8664-e96ee58512e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:39.829234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a080c3-bc69-4aa9-8664-e96ee58512e3 None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:39.829955 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a080c3-bc69-4aa9-8664-e96ee58512e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:39.830263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a080c3-bc69-4aa9-8664-e96ee58512e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:39.831724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a080c3-bc69-4aa9-8664-e96ee58512e3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:39.849329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 618/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 12:02:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:39.856381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ee246-5aa3-4577-9970-07b92de91831 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:39.954990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ee246-5aa3-4577-9970-07b92de91831 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:39.987810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6d99-66ef-47d0-a7c9-b109dc3049ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:39.988427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6d99-66ef-47d0-a7c9-b109dc3049ef None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:39.988712 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6d99-66ef-47d0-a7c9-b109dc3049ef None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:39.988989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6d99-66ef-47d0-a7c9-b109dc3049ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:40.047692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:40.060698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a6d99-66ef-47d0-a7c9-b109dc3049ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:40.062133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a6d99-66ef-47d0-a7c9-b109dc3049ef None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:40.164255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 637/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:02:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:02:40.170774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a080c3-bc69-4aa9-8664-e96ee58512e3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:40.269833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a080c3-bc69-4aa9-8664-e96ee58512e3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:40.283494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:40.304835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87540d58-cd68-47bb-983f-ae52e2b4ca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:40.305397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87540d58-cd68-47bb-983f-ae52e2b4ca83 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:40.305680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87540d58-cd68-47bb-983f-ae52e2b4ca83 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:40.305954 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87540d58-cd68-47bb-983f-ae52e2b4ca83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:40.315605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87540d58-cd68-47bb-983f-ae52e2b4ca83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:40.317181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87540d58-cd68-47bb-983f-ae52e2b4ca83 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-87540d58-cd68-47bb-983f-ae52e2b4ca83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:40.332146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:40.333372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:40.334523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:40.334523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:40.334523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:40.334523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 619/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:40.339872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6d99-66ef-47d0-a7c9-b109dc3049ef None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:40.423808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:40.436271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6d99-66ef-47d0-a7c9-b109dc3049ef None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:40.471895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef54864-e4f6-4936-9d22-49f1ca7e71f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:40.472505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef54864-e4f6-4936-9d22-49f1ca7e71f0 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:40.472886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef54864-e4f6-4936-9d22-49f1ca7e71f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:40.473112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef54864-e4f6-4936-9d22-49f1ca7e71f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:40.473751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef54864-e4f6-4936-9d22-49f1ca7e71f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:40.474055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef54864-e4f6-4936-9d22-49f1ca7e71f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:40.475409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef54864-e4f6-4936-9d22-49f1ca7e71f0 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:40.487448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 638/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:40.493328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87540d58-cd68-47bb-983f-ae52e2b4ca83 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:40.594475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87540d58-cd68-47bb-983f-ae52e2b4ca83 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:40.629358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614165a0-0227-4e71-841a-cdc4a7925cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:40.629989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614165a0-0227-4e71-841a-cdc4a7925cfd None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:40.630268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614165a0-0227-4e71-841a-cdc4a7925cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:40.630546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614165a0-0227-4e71-841a-cdc4a7925cfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:40.638238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614165a0-0227-4e71-841a-cdc4a7925cfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:40.639839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614165a0-0227-4e71-841a-cdc4a7925cfd None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-614165a0-0227-4e71-841a-cdc4a7925cfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 12:02:40.651209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:40.652868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:40.653998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 12:02:40.653998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 12:02:40.653998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:02:40.653998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:02:40.653998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:02:40.653998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:02:40.653998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:40.653998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:40.653998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 620/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:40.658958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef54864-e4f6-4936-9d22-49f1ca7e71f0 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:40.756613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef54864-e4f6-4936-9d22-49f1ca7e71f0 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:40.790010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d945d6-27c1-4abf-ba76-f37f5b959c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:40.790610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d945d6-27c1-4abf-ba76-f37f5b959c27 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:40.790898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d945d6-27c1-4abf-ba76-f37f5b959c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:40.791167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d945d6-27c1-4abf-ba76-f37f5b959c27 None admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:40.791872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d945d6-27c1-4abf-ba76-f37f5b959c27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:40.792180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d945d6-27c1-4abf-ba76-f37f5b959c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:40.793591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d945d6-27c1-4abf-ba76-f37f5b959c27 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:40.805231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 639/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 12:02:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:40.811439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614165a0-0227-4e71-841a-cdc4a7925cfd None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:40.837004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:40.915962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614165a0-0227-4e71-841a-cdc4a7925cfd None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:40.952322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362cd51-0413-4e04-ab37-226e7363c37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:40.952931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362cd51-0413-4e04-ab37-226e7363c37e None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:40.953216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362cd51-0413-4e04-ab37-226e7363c37e None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:40.953489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362cd51-0413-4e04-ab37-226e7363c37e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:40.954211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362cd51-0413-4e04-ab37-226e7363c37e None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=03a4b508dd7048df83f7beeacfe9c085) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:40.954523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362cd51-0413-4e04-ab37-226e7363c37e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:40.955992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362cd51-0413-4e04-ab37-226e7363c37e None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:40.961608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 621/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:02:40 2022] GET /identity/v3/role_assignments?user.id=03a4b508dd7048df83f7beeacfe9c085&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=06592016669243d99b430c46dd1c1d46 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:43.120450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513974b-e090-476c-a878-c8187224daba None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:43.120942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513974b-e090-476c-a878-c8187224daba None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:43.120942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513974b-e090-476c-a878-c8187224daba None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:43.122251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 640/1261] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:02:43.127664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718456ec-c943-4536-aace-d683bd1ce0c6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:43.128090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718456ec-c943-4536-aace-d683bd1ce0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:43.128223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718456ec-c943-4536-aace-d683bd1ce0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:43.146999 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-718456ec-c943-4536-aace-d683bd1ce0c6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:43.148214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-718456ec-c943-4536-aace-d683bd1ce0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:43.213185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 622/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:02:43.483981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513974b-e090-476c-a878-c8187224daba None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:43.495123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:43.586130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513974b-e090-476c-a878-c8187224daba None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:43.621671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fce924-98be-48ca-a9f4-1c0412e4501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:43.622297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fce924-98be-48ca-a9f4-1c0412e4501c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:43.622594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fce924-98be-48ca-a9f4-1c0412e4501c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:43.622847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fce924-98be-48ca-a9f4-1c0412e4501c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:43.632651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fce924-98be-48ca-a9f4-1c0412e4501c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-38fce924-98be-48ca-a9f4-1c0412e4501c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:02:43.638126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:43.639262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:02:43.640353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:43.643793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 641/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 12:02:43.645412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718456ec-c943-4536-aace-d683bd1ce0c6 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:43.663695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:43.741330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718456ec-c943-4536-aace-d683bd1ce0c6 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:43.776092 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd771dc3-b7ad-4a00-b79d-9a090353d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:43.777270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd771dc3-b7ad-4a00-b79d-9a090353d72d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:43.777553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd771dc3-b7ad-4a00-b79d-9a090353d72d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:43.777825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd771dc3-b7ad-4a00-b79d-9a090353d72d None admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:43.778498 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd771dc3-b7ad-4a00-b79d-9a090353d72d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:43.778797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd771dc3-b7ad-4a00-b79d-9a090353d72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:43.780204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd771dc3-b7ad-4a00-b79d-9a090353d72d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:43.788753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 623/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:43.794556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fce924-98be-48ca-a9f4-1c0412e4501c None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:43.860772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:43.893474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fce924-98be-48ca-a9f4-1c0412e4501c None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:43.927440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf2bc7-5caf-466a-9e18-d560cb5c6d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:43.928133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf2bc7-5caf-466a-9e18-d560cb5c6d2a None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:43.928744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf2bc7-5caf-466a-9e18-d560cb5c6d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:43.929099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf2bc7-5caf-466a-9e18-d560cb5c6d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:43.941006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf2bc7-5caf-466a-9e18-d560cb5c6d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:43.942446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf2bc7-5caf-466a-9e18-d560cb5c6d2a None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-14bf2bc7-5caf-466a-9e18-d560cb5c6d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:43.957583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:43.958761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:43.959720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:43.959720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:43.959720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:43.959720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 642/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:43.965254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd771dc3-b7ad-4a00-b79d-9a090353d72d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:44.058486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:44.078890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd771dc3-b7ad-4a00-b79d-9a090353d72d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:44.127278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce272f-334c-40a2-9a6b-dcb83c23872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:44.127884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce272f-334c-40a2-9a6b-dcb83c23872d None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:44.128391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce272f-334c-40a2-9a6b-dcb83c23872d None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:44.128496 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce272f-334c-40a2-9a6b-dcb83c23872d None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:44.129067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce272f-334c-40a2-9a6b-dcb83c23872d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:44.129373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce272f-334c-40a2-9a6b-dcb83c23872d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:44.130777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce272f-334c-40a2-9a6b-dcb83c23872d None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:44.144221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 624/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:44.150090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf2bc7-5caf-466a-9e18-d560cb5c6d2a None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:44.252092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf2bc7-5caf-466a-9e18-d560cb5c6d2a None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:44.277151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:44.294073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ec8b0-6666-470c-9d23-5d1cf81695cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:44.294961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ec8b0-6666-470c-9d23-5d1cf81695cb None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:44.295394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ec8b0-6666-470c-9d23-5d1cf81695cb None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:44.295921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ec8b0-6666-470c-9d23-5d1cf81695cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:44.303861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ec8b0-6666-470c-9d23-5d1cf81695cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:44.305310 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ec8b0-6666-470c-9d23-5d1cf81695cb None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-6f9ec8b0-6666-470c-9d23-5d1cf81695cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 12:02:44.317400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:44.318581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:44.319771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 643/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:44.325182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce272f-334c-40a2-9a6b-dcb83c23872d None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:44.425113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce272f-334c-40a2-9a6b-dcb83c23872d None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:44.461798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20917914-837f-4984-8b44-096a97c9578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:44.462413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917914-837f-4984-8b44-096a97c9578f None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:44.462691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917914-837f-4984-8b44-096a97c9578f None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:44.462964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917914-837f-4984-8b44-096a97c9578f None admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:44.463725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20917914-837f-4984-8b44-096a97c9578f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:44.464029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20917914-837f-4984-8b44-096a97c9578f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:44.466127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20917914-837f-4984-8b44-096a97c9578f None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:44.475460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:44.484415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 625/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 12:02:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:44.490436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ec8b0-6666-470c-9d23-5d1cf81695cb None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:44.592979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ec8b0-6666-470c-9d23-5d1cf81695cb None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:44.628894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d9498-dc89-4c49-99a1-9f8fdc56d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:44.629531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d9498-dc89-4c49-99a1-9f8fdc56d41b None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:44.629811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d9498-dc89-4c49-99a1-9f8fdc56d41b None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:44.630134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d9498-dc89-4c49-99a1-9f8fdc56d41b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:44.640862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d9498-dc89-4c49-99a1-9f8fdc56d41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:44.642423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d9498-dc89-4c49-99a1-9f8fdc56d41b None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0f5d9498-dc89-4c49-99a1-9f8fdc56d41b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:44.656268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:44.657406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:44.658704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:44.658704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:44.658704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:44.658704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 644/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:44.663255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20917914-837f-4984-8b44-096a97c9578f None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:44.761724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20917914-837f-4984-8b44-096a97c9578f None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:44.795936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673947fe-2e0d-4a49-9beb-4337a62bb4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:44.796542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673947fe-2e0d-4a49-9beb-4337a62bb4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:44.796826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673947fe-2e0d-4a49-9beb-4337a62bb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:44.797104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673947fe-2e0d-4a49-9beb-4337a62bb4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:44.797736 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673947fe-2e0d-4a49-9beb-4337a62bb4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:44.798117 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673947fe-2e0d-4a49-9beb-4337a62bb4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:44.799493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673947fe-2e0d-4a49-9beb-4337a62bb4a3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:44.810598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 626/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:44.816632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d9498-dc89-4c49-99a1-9f8fdc56d41b None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:44.848363 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:44.915348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d9498-dc89-4c49-99a1-9f8fdc56d41b None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:44.956919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bc01a-0f96-47b5-b875-bc834ee16191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:44.957884 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bc01a-0f96-47b5-b875-bc834ee16191 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:44.958161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bc01a-0f96-47b5-b875-bc834ee16191 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:44.958438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bc01a-0f96-47b5-b875-bc834ee16191 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:44.966574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bc01a-0f96-47b5-b875-bc834ee16191 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:44.969418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bc01a-0f96-47b5-b875-bc834ee16191 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-3a9bc01a-0f96-47b5-b875-bc834ee16191 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 12:02:44.980671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:44.981726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:44.983148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 12:02:44.983148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 12:02:44.983148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:02:44.983148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:02:44.983148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:02:44.983148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:02:44.983148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:44.983148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:44.983148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 645/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:44.987786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673947fe-2e0d-4a49-9beb-4337a62bb4a3 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:45.049274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:45.091141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673947fe-2e0d-4a49-9beb-4337a62bb4a3 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:45.124249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee933913-e7e2-4fa6-8eb7-48e43620b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:45.124861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee933913-e7e2-4fa6-8eb7-48e43620b3ff None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:45.125146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee933913-e7e2-4fa6-8eb7-48e43620b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:45.125424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee933913-e7e2-4fa6-8eb7-48e43620b3ff None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:45.126113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee933913-e7e2-4fa6-8eb7-48e43620b3ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:45.126430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee933913-e7e2-4fa6-8eb7-48e43620b3ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:45.127878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee933913-e7e2-4fa6-8eb7-48e43620b3ff None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:45.141480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 627/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 12:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:45.147676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bc01a-0f96-47b5-b875-bc834ee16191 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:45.239827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:45.248212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bc01a-0f96-47b5-b875-bc834ee16191 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:45.282958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4e2a7-7f9a-4531-96e1-e270f81f3d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:45.283685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4e2a7-7f9a-4531-96e1-e270f81f3d1f None admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:45.283947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4e2a7-7f9a-4531-96e1-e270f81f3d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:45.284217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4e2a7-7f9a-4531-96e1-e270f81f3d1f None admin] PATH_INFO: `/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/03a4b508dd7048df83f7beeacfe9c085/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:45.286137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4e2a7-7f9a-4531-96e1-e270f81f3d1f None admin] RBAC: Authorizing `identity:create_grant(project_id=eebdfd43dee3423ba80b8c624e371e6f, user_id=03a4b508dd7048df83f7beeacfe9c085, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:45.287572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4e2a7-7f9a-4531-96e1-e270f81f3d1f None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:45.341699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 646/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 12:02:45 2022] PUT /identity/v3/projects/eebdfd43dee3423ba80b8c624e371e6f/users/03a4b508dd7048df83f7beeacfe9c085/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:02:47.504194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fffb06-c83c-45a7-a160-235ada8a6c80 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:47.504747 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fffb06-c83c-45a7-a160-235ada8a6c80 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:47.504747 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fffb06-c83c-45a7-a160-235ada8a6c80 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:47.505981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 628/1274] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:02:47.511743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bec8b-72f7-4398-a9cf-e34ba21f990b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:47.512454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bec8b-72f7-4398-a9cf-e34ba21f990b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:47.512554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bec8b-72f7-4398-a9cf-e34ba21f990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:47.530927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-926bec8b-72f7-4398-a9cf-e34ba21f990b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:47.532149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-926bec8b-72f7-4398-a9cf-e34ba21f990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:47.597609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 647/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:02:47.870075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fffb06-c83c-45a7-a160-235ada8a6c80 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:47.972257 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fffb06-c83c-45a7-a160-235ada8a6c80 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:47.989955 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:48.006976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953fc60-bb28-40eb-9778-f96e2fa63695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:48.007608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953fc60-bb28-40eb-9778-f96e2fa63695 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:48.007911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953fc60-bb28-40eb-9778-f96e2fa63695 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:48.008188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953fc60-bb28-40eb-9778-f96e2fa63695 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:48.018802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953fc60-bb28-40eb-9778-f96e2fa63695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-3953fc60-bb28-40eb-9778-f96e2fa63695 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 12:02:48.023588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:48.027528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:48.028525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 629/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 12:02:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:48.030918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bec8b-72f7-4398-a9cf-e34ba21f990b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:48.111660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:48.134373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bec8b-72f7-4398-a9cf-e34ba21f990b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:48.163421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304580cc-38c6-4170-8098-8664a6f4cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:48.164057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304580cc-38c6-4170-8098-8664a6f4cfbd None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:48.164334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304580cc-38c6-4170-8098-8664a6f4cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:48.164607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304580cc-38c6-4170-8098-8664a6f4cfbd None admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:48.165262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304580cc-38c6-4170-8098-8664a6f4cfbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:48.165564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304580cc-38c6-4170-8098-8664a6f4cfbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:48.166912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304580cc-38c6-4170-8098-8664a6f4cfbd None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:48.175272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 648/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 12:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:48.181524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953fc60-bb28-40eb-9778-f96e2fa63695 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:48.286606 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953fc60-bb28-40eb-9778-f96e2fa63695 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:48.322187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a33cac-2c7a-4f5f-849a-f2ee60536191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:48.322849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a33cac-2c7a-4f5f-849a-f2ee60536191 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:48.323128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a33cac-2c7a-4f5f-849a-f2ee60536191 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:48.323407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a33cac-2c7a-4f5f-849a-f2ee60536191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:48.333724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a33cac-2c7a-4f5f-849a-f2ee60536191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:48.335218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a33cac-2c7a-4f5f-849a-f2ee60536191 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-42a33cac-2c7a-4f5f-849a-f2ee60536191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:48.349761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:48.350869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:48.351854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:48.351854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:48.351854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:48.351854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 630/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:48.358089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304580cc-38c6-4170-8098-8664a6f4cfbd None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:48.457441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304580cc-38c6-4170-8098-8664a6f4cfbd None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:48.491848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ac1c-f7b3-44a5-a05b-24574eef5668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:48.492455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ac1c-f7b3-44a5-a05b-24574eef5668 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:48.492734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ac1c-f7b3-44a5-a05b-24574eef5668 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:48.493009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ac1c-f7b3-44a5-a05b-24574eef5668 None admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:48.493647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416ac1c-f7b3-44a5-a05b-24574eef5668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:48.493953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416ac1c-f7b3-44a5-a05b-24574eef5668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:48.495401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416ac1c-f7b3-44a5-a05b-24574eef5668 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:48.510984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 649/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:48.517227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a33cac-2c7a-4f5f-849a-f2ee60536191 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:48.549085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:48.626610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a33cac-2c7a-4f5f-849a-f2ee60536191 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:48.662197 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dcace-6fc2-4dda-aae4-81c5143151e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:48.662825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dcace-6fc2-4dda-aae4-81c5143151e5 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:48.663106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dcace-6fc2-4dda-aae4-81c5143151e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:48.663377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dcace-6fc2-4dda-aae4-81c5143151e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:48.670722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dcace-6fc2-4dda-aae4-81c5143151e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:48.672206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dcace-6fc2-4dda-aae4-81c5143151e5 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-bb6dcace-6fc2-4dda-aae4-81c5143151e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 12:02:48.683549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:48.684749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:48.685731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 631/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:48.690689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ac1c-f7b3-44a5-a05b-24574eef5668 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:48.694449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:48.794198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ac1c-f7b3-44a5-a05b-24574eef5668 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:48.828077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736e291-05f2-436e-a357-be4586041fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:48.828679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736e291-05f2-436e-a357-be4586041fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:48.828961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736e291-05f2-436e-a357-be4586041fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:48.829237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736e291-05f2-436e-a357-be4586041fe6 None admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:48.830002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736e291-05f2-436e-a357-be4586041fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:48.830310 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736e291-05f2-436e-a357-be4586041fe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:48.831945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736e291-05f2-436e-a357-be4586041fe6 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:48.850169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 650/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 12:02:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:48.856277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dcace-6fc2-4dda-aae4-81c5143151e5 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:48.950831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:48.960477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dcace-6fc2-4dda-aae4-81c5143151e5 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:48.994364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f09ca7-d3d6-40f1-ba9a-aa354f9ca139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:48.994970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09ca7-d3d6-40f1-ba9a-aa354f9ca139 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:48.995253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09ca7-d3d6-40f1-ba9a-aa354f9ca139 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:48.996160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09ca7-d3d6-40f1-ba9a-aa354f9ca139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:49.062200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f09ca7-d3d6-40f1-ba9a-aa354f9ca139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:49.063573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f09ca7-d3d6-40f1-ba9a-aa354f9ca139 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:49.151440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:49.161530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 632/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 12:02:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 12:02:49.168034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736e291-05f2-436e-a357-be4586041fe6 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:49.231261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:49.267725 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736e291-05f2-436e-a357-be4586041fe6 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:49.300286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead08f3-38b1-4010-a70a-5b7260294586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:49.300903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead08f3-38b1-4010-a70a-5b7260294586 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:49.301177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead08f3-38b1-4010-a70a-5b7260294586 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:49.301451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead08f3-38b1-4010-a70a-5b7260294586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:49.316879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead08f3-38b1-4010-a70a-5b7260294586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:49.316879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead08f3-38b1-4010-a70a-5b7260294586 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-0ead08f3-38b1-4010-a70a-5b7260294586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 12:02:49.327881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:49.328999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 12:02:49.330340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 12:02:49.330340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 12:02:49.330340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:49.330340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 651/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:49.334989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f09ca7-d3d6-40f1-ba9a-aa354f9ca139 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:49.432525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f09ca7-d3d6-40f1-ba9a-aa354f9ca139 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:49.466181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91e479-e4f7-4238-b509-43007aedb63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:49.466783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91e479-e4f7-4238-b509-43007aedb63b None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:49.467063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91e479-e4f7-4238-b509-43007aedb63b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:49.467337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91e479-e4f7-4238-b509-43007aedb63b None admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:49.468000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91e479-e4f7-4238-b509-43007aedb63b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:49.468306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91e479-e4f7-4238-b509-43007aedb63b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:49.469669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91e479-e4f7-4238-b509-43007aedb63b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:49.481433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 633/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 12:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:02:49.487165 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead08f3-38b1-4010-a70a-5b7260294586 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:49.585421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead08f3-38b1-4010-a70a-5b7260294586 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:49.599809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:49.619085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eb4f6-6d11-4ae2-a3c2-4a84499214ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:49.619743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb4f6-6d11-4ae2-a3c2-4a84499214ee None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:49.620067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb4f6-6d11-4ae2-a3c2-4a84499214ee None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:49.620305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb4f6-6d11-4ae2-a3c2-4a84499214ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:49.626797 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eb4f6-6d11-4ae2-a3c2-4a84499214ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:49.628264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eb4f6-6d11-4ae2-a3c2-4a84499214ee None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application [None req-5b8eb4f6-6d11-4ae2-a3c2-4a84499214ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 12:02:49.640116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:49.645039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:49.647068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 12:02:49.647068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 12:02:49.647068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 12:02:49.647068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 12:02:49.647068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 12:02:49.647068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 12:02:49.647068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 12:02:49.647068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: ERROR keystone.server.flask.application Sep 09 12:02:49.647068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 652/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 12:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:49.649740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91e479-e4f7-4238-b509-43007aedb63b None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:49.700352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:49.750781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91e479-e4f7-4238-b509-43007aedb63b None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:49.787299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad0544-7733-41f8-9087-f8ddec42e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:49.787948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad0544-7733-41f8-9087-f8ddec42e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:49.788241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad0544-7733-41f8-9087-f8ddec42e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:49.788513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad0544-7733-41f8-9087-f8ddec42e1c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:49.789231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad0544-7733-41f8-9087-f8ddec42e1c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:49.789544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad0544-7733-41f8-9087-f8ddec42e1c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:49.791040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad0544-7733-41f8-9087-f8ddec42e1c3 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:49.803874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 634/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 12:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:02:49.810212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eb4f6-6d11-4ae2-a3c2-4a84499214ee None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:49.909689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eb4f6-6d11-4ae2-a3c2-4a84499214ee None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:49.943756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee014a-ab84-4acc-9720-95997d7c2ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:49.944354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee014a-ab84-4acc-9720-95997d7c2ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:49.944653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee014a-ab84-4acc-9720-95997d7c2ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:49.944909 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee014a-ab84-4acc-9720-95997d7c2ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:49.945624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee014a-ab84-4acc-9720-95997d7c2ab2 None admin] RBAC: Adding query filter params (role.id=06592016669243d99b430c46dd1c1d46, scope.project.id=eebdfd43dee3423ba80b8c624e371e6f, user.id=03a4b508dd7048df83f7beeacfe9c085) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:49.945933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee014a-ab84-4acc-9720-95997d7c2ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:49.947341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee014a-ab84-4acc-9720-95997d7c2ab2 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:49.953047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 653/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 12:02:49 2022] GET /identity/v3/role_assignments?user.id=03a4b508dd7048df83f7beeacfe9c085&scope.project.id=eebdfd43dee3423ba80b8c624e371e6f&role.id=06592016669243d99b430c46dd1c1d46 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:52.154040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1bf67-243f-460b-840d-41c1917b1ecd None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:52.154596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1bf67-243f-460b-840d-41c1917b1ecd None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:52.154596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1bf67-243f-460b-840d-41c1917b1ecd None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:52.156099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 635/1288] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:02:52.161656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246f0be-d87c-4204-b49a-555b73784065 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:52.162085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246f0be-d87c-4204-b49a-555b73784065 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:52.162217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246f0be-d87c-4204-b49a-555b73784065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:52.180049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2246f0be-d87c-4204-b49a-555b73784065 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:52.185834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2246f0be-d87c-4204-b49a-555b73784065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:52.209961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:52.247414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 654/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:02:52.512216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1bf67-243f-460b-840d-41c1917b1ecd None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:52.621822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1bf67-243f-460b-840d-41c1917b1ecd None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:52.635767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:52.658362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a323f-c386-4d91-a07f-90cc6c117255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:52.658986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a323f-c386-4d91-a07f-90cc6c117255 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:52.659268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a323f-c386-4d91-a07f-90cc6c117255 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:52.659540 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a323f-c386-4d91-a07f-90cc6c117255 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:52.660149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a323f-c386-4d91-a07f-90cc6c117255 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:52.661582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a323f-c386-4d91-a07f-90cc6c117255 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-4a4a323f-c386-4d91-a07f-90cc6c117255 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:52.671201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:52.672601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:52.673613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 636/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 12:02:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:52.678603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246f0be-d87c-4204-b49a-555b73784065 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:52.777105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246f0be-d87c-4204-b49a-555b73784065 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:52.811781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1ce9d-394b-4645-9489-e122695e8737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:52.812429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ce9d-394b-4645-9489-e122695e8737 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:52.812711 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ce9d-394b-4645-9489-e122695e8737 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:52.812986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ce9d-394b-4645-9489-e122695e8737 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:52.813614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1ce9d-394b-4645-9489-e122695e8737 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:52.813926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1ce9d-394b-4645-9489-e122695e8737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:52.815341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1ce9d-394b-4645-9489-e122695e8737 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:52.820159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 655/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Sep 9 12:02:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:52.825979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a323f-c386-4d91-a07f-90cc6c117255 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:52.924602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a323f-c386-4d91-a07f-90cc6c117255 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:52.958123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda7d94-41fd-4ec1-98fd-a69a6486f50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:52.958778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda7d94-41fd-4ec1-98fd-a69a6486f50b None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:52.959107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda7d94-41fd-4ec1-98fd-a69a6486f50b None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:52.959425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda7d94-41fd-4ec1-98fd-a69a6486f50b None admin] PATH_INFO: `/v3/services` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:52.960126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda7d94-41fd-4ec1-98fd-a69a6486f50b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:52.960477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda7d94-41fd-4ec1-98fd-a69a6486f50b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:52.961939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda7d94-41fd-4ec1-98fd-a69a6486f50b None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:52.966948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 637/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Sep 9 12:02:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:55.137744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07646634-7bce-4bf1-b5ec-765d0765108e None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:55.138246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07646634-7bce-4bf1-b5ec-765d0765108e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:55.138360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07646634-7bce-4bf1-b5ec-765d0765108e None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:55.139642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 656/1293] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:02:55.145006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb75d4-4b0e-4e13-91d1-85ffc312eef7 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:55.149389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb75d4-4b0e-4e13-91d1-85ffc312eef7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:55.149389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb75d4-4b0e-4e13-91d1-85ffc312eef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:55.164219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-3eeb75d4-4b0e-4e13-91d1-85ffc312eef7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:55.165413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3eeb75d4-4b0e-4e13-91d1-85ffc312eef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:55.195972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:55.233770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 638/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:02:55.507075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07646634-7bce-4bf1-b5ec-765d0765108e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:55.538379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:55.610692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07646634-7bce-4bf1-b5ec-765d0765108e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:55.644983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db1fd-93e2-4757-97b2-d6e431ef5718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:55.645583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db1fd-93e2-4757-97b2-d6e431ef5718 None admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:55.645865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db1fd-93e2-4757-97b2-d6e431ef5718 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:55.646141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db1fd-93e2-4757-97b2-d6e431ef5718 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:55.646791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197db1fd-93e2-4757-97b2-d6e431ef5718 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:55.648174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197db1fd-93e2-4757-97b2-d6e431ef5718 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:55.725046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 657/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 12:02:55 2022] POST /identity/v3/services => generated 246 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:02:57.915232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668ce5-0ce3-40b9-9a02-6397d980bfbb None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:57.915815 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668ce5-0ce3-40b9-9a02-6397d980bfbb None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:57.915815 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668ce5-0ce3-40b9-9a02-6397d980bfbb None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:57.917157 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 639/1296] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 12:02:57.923501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9afe1-5207-4d02-a6ad-9267dcdb7cd1 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:57.923969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9afe1-5207-4d02-a6ad-9267dcdb7cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:57.924080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9afe1-5207-4d02-a6ad-9267dcdb7cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:57.942592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-50b9afe1-5207-4d02-a6ad-9267dcdb7cd1 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:02:57.945317 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-50b9afe1-5207-4d02-a6ad-9267dcdb7cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:02:58.014453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 658/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:02:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 12:02:58.284284 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668ce5-0ce3-40b9-9a02-6397d980bfbb None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:58.385512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668ce5-0ce3-40b9-9a02-6397d980bfbb None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:58.418456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1915a-4716-4941-b814-3578ebc6be30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:58.419079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1915a-4716-4941-b814-3578ebc6be30 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:58.419357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1915a-4716-4941-b814-3578ebc6be30 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:58.419658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1915a-4716-4941-b814-3578ebc6be30 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:58.420223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1915a-4716-4941-b814-3578ebc6be30 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:58.421578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1915a-4716-4941-b814-3578ebc6be30 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-82c1915a-4716-4941-b814-3578ebc6be30 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:02:58.430087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:02:58.431445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:02:58.432412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 640/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 12:02:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:02:58.438705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9afe1-5207-4d02-a6ad-9267dcdb7cd1 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:58.457791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:58.536917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9afe1-5207-4d02-a6ad-9267dcdb7cd1 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:58.570193 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95cc34-27cb-424c-88b8-7b378c33e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:58.570797 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95cc34-27cb-424c-88b8-7b378c33e236 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:58.571084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95cc34-27cb-424c-88b8-7b378c33e236 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:58.571362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95cc34-27cb-424c-88b8-7b378c33e236 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:58.572018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95cc34-27cb-424c-88b8-7b378c33e236 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:58.572328 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95cc34-27cb-424c-88b8-7b378c33e236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:58.573682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95cc34-27cb-424c-88b8-7b378c33e236 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:58.583810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 659/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Sep 9 12:02:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:58.587886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1915a-4716-4941-b814-3578ebc6be30 None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:58.620094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:58.696369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1915a-4716-4941-b814-3578ebc6be30 None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:58.729961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d344208-6688-4616-900c-85a6e07ca4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:58.731065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d344208-6688-4616-900c-85a6e07ca4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:58.731345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d344208-6688-4616-900c-85a6e07ca4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:58.731617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d344208-6688-4616-900c-85a6e07ca4c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:58.732332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d344208-6688-4616-900c-85a6e07ca4c7 None admin] RBAC: Adding query filter params (interface=public, service_id=116257a676e4480fa091ee169f0060ae, region_id=RegionOne) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:02:58.732643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d344208-6688-4616-900c-85a6e07ca4c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:58.734003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d344208-6688-4616-900c-85a6e07ca4c7 None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:58.739018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 641/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 12:02:58 2022] GET /identity/v3/endpoints?service_id=116257a676e4480fa091ee169f0060ae&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:02:58.744964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95cc34-27cb-424c-88b8-7b378c33e236 None admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:02:58.824554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:02:58.841701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95cc34-27cb-424c-88b8-7b378c33e236 None admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:02:58.875424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d9e66-622d-4f1d-aa27-6a8d6131cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:02:58.876050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d9e66-622d-4f1d-aa27-6a8d6131cc4c None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:02:58.876334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d9e66-622d-4f1d-aa27-6a8d6131cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:02:58.876604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d9e66-622d-4f1d-aa27-6a8d6131cc4c None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:02:58.877198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d9e66-622d-4f1d-aa27-6a8d6131cc4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:02:58.878584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d9e66-622d-4f1d-aa27-6a8d6131cc4c None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:02:58.885222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 660/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 12:02:58 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:03:01.060428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e269d7-df33-429b-abf5-61449fe709f5 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:03:01.060962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e269d7-df33-429b-abf5-61449fe709f5 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:03:01.061055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e269d7-df33-429b-abf5-61449fe709f5 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:03:01.062349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 642/1302] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:03:01.067610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76324a40-fd10-4552-b229-21b61082579b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:03:01.068047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76324a40-fd10-4552-b229-21b61082579b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:03:01.068212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76324a40-fd10-4552-b229-21b61082579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:03:01.086233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-76324a40-fd10-4552-b229-21b61082579b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:03:01.087412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-76324a40-fd10-4552-b229-21b61082579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:03:01.154327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 661/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:03:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 12:03:01.424037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e269d7-df33-429b-abf5-61449fe709f5 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:03:01.520479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:03:01.527342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e269d7-df33-429b-abf5-61449fe709f5 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:03:01.563085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dec9d-0379-4fcf-9bf8-c2d2785144ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:03:01.563747 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dec9d-0379-4fcf-9bf8-c2d2785144ec None admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:03:01.564033 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dec9d-0379-4fcf-9bf8-c2d2785144ec None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:03:01.564311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dec9d-0379-4fcf-9bf8-c2d2785144ec None admin] PATH_INFO: `/v3/services/placement` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:03:01.564892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dec9d-0379-4fcf-9bf8-c2d2785144ec None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:03:01.566263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dec9d-0379-4fcf-9bf8-c2d2785144ec None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application [None req-753dec9d-0379-4fcf-9bf8-c2d2785144ec None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 12:03:01.575521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 12:03:01.576717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application with Lock( Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self._enter() Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application return self.creator() Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application created_value = creator( Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: ERROR keystone.server.flask.application Sep 09 12:03:01.577733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 643/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 12:03:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 12:03:01.582699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76324a40-fd10-4552-b229-21b61082579b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:03:01.658701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:03:01.681660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76324a40-fd10-4552-b229-21b61082579b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:03:01.714484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ec2a0-3b76-4b7d-a630-0bc0b686fc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:03:01.715090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec2a0-3b76-4b7d-a630-0bc0b686fc34 None admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:03:01.715369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec2a0-3b76-4b7d-a630-0bc0b686fc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:03:01.715660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec2a0-3b76-4b7d-a630-0bc0b686fc34 None admin] PATH_INFO: `/v3/services` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:03:01.716284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec2a0-3b76-4b7d-a630-0bc0b686fc34 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:03:01.716586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec2a0-3b76-4b7d-a630-0bc0b686fc34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:03:01.717980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec2a0-3b76-4b7d-a630-0bc0b686fc34 None admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:03:01.722849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 662/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Sep 9 12:03:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:03:01.729075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dec9d-0379-4fcf-9bf8-c2d2785144ec None admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:03:01.828767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dec9d-0379-4fcf-9bf8-c2d2785144ec None admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:03:01.862013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd017dd-1d1b-4b58-a2d9-9488fd560add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:03:01.862614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd017dd-1d1b-4b58-a2d9-9488fd560add None admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:03:01.862896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd017dd-1d1b-4b58-a2d9-9488fd560add None admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:03:01.863167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd017dd-1d1b-4b58-a2d9-9488fd560add None admin] PATH_INFO: `/v3/endpoints` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:03:01.863863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd017dd-1d1b-4b58-a2d9-9488fd560add None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:03:01.865231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd017dd-1d1b-4b58-a2d9-9488fd560add None admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:03:01.948329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 644/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:03:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:03:11.753947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=30 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:03:11.943585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:16.503697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0db9-7705-49f6-a792-6e99e65cd54e None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:16.504184 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0db9-7705-49f6-a792-6e99e65cd54e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:16.504417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0db9-7705-49f6-a792-6e99e65cd54e None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:16.511857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1aa7f-dd5b-4597-a6db-8d8c6f02427a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:16.512262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1aa7f-dd5b-4597-a6db-8d8c6f02427a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:16.512262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1aa7f-dd5b-4597-a6db-8d8c6f02427a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:16.517274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 663/1307] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:16 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:16.606565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-23e1aa7f-dd5b-4597-a6db-8d8c6f02427a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:16.608549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-23e1aa7f-dd5b-4597-a6db-8d8c6f02427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:16.736456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 645/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:17.032517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e897f-e2ce-417f-a404-7714cd178196 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:17.032879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e897f-e2ce-417f-a404-7714cd178196 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:17.033398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e897f-e2ce-417f-a404-7714cd178196 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:17.034833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 664/1309] 10.222.0.27 () {54 vars in 965 bytes} [Fri Sep 9 12:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:17.040989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ebb16-c881-4c70-91b4-d1ff1da99eea None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:17.041557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ebb16-c881-4c70-91b4-d1ff1da99eea None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:17.042047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ebb16-c881-4c70-91b4-d1ff1da99eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:17.137632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ae5ebb16-c881-4c70-91b4-d1ff1da99eea None None] MFA Rules not processed for user `88d492b570be4de4b6a6d85f6374ed31`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:17.139023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ae5ebb16-c881-4c70-91b4-d1ff1da99eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:17.162909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:17.228396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 646/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Sep 9 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:17.236299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e897f-e2ce-417f-a404-7714cd178196 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:17.238095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-007e897f-e2ce-417f-a404-7714cd178196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:17.364695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e897f-e2ce-417f-a404-7714cd178196 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:17.449256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e84b9-024a-44a4-8249-c266991473b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:17.449875 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e84b9-024a-44a4-8249-c266991473b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:17.450155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e84b9-024a-44a4-8249-c266991473b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:17.450427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e84b9-024a-44a4-8249-c266991473b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:17.452058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-287e84b9-024a-44a4-8249-c266991473b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:17.510802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:17.579669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e84b9-024a-44a4-8249-c266991473b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:17.581097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e84b9-024a-44a4-8249-c266991473b2 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:17.601023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 665/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:20.202482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7b202-229a-4391-9c14-a0d48ee33e07 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:20.203007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7b202-229a-4391-9c14-a0d48ee33e07 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:20.203007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7b202-229a-4391-9c14-a0d48ee33e07 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:20.204300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 647/1312] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:20.209537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee1487-4a04-4fdc-b26f-4ff0313fb067 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:20.210009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee1487-4a04-4fdc-b26f-4ff0313fb067 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:20.210154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee1487-4a04-4fdc-b26f-4ff0313fb067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:20.299471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-bbee1487-4a04-4fdc-b26f-4ff0313fb067 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:20.300810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bbee1487-4a04-4fdc-b26f-4ff0313fb067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:20.396861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 666/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:20.682071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7b202-229a-4391-9c14-a0d48ee33e07 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:20.684351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-dfd7b202-229a-4391-9c14-a0d48ee33e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:20.788004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7b202-229a-4391-9c14-a0d48ee33e07 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:20.859240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:20.862115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2142197-1681-4b9b-a71b-7cc0b8adeecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:20.862725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2142197-1681-4b9b-a71b-7cc0b8adeecd service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:20.863004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2142197-1681-4b9b-a71b-7cc0b8adeecd service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:20.863273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2142197-1681-4b9b-a71b-7cc0b8adeecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:20.865280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e2142197-1681-4b9b-a71b-7cc0b8adeecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:20.982307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2142197-1681-4b9b-a71b-7cc0b8adeecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:20.983758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2142197-1681-4b9b-a71b-7cc0b8adeecd service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:21.001799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 648/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:23.732828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f376b6-e5bc-40c8-a406-f778844cd439 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:23.733393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f376b6-e5bc-40c8-a406-f778844cd439 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:23.733393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f376b6-e5bc-40c8-a406-f778844cd439 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:23.734899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 667/1315] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:23.740214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18941b46-a48e-4f7b-b444-7be1b09cd9cf None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:23.740664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18941b46-a48e-4f7b-b444-7be1b09cd9cf None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:23.740762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18941b46-a48e-4f7b-b444-7be1b09cd9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:23.805303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-18941b46-a48e-4f7b-b444-7be1b09cd9cf None None] MFA Rules not processed for user `a1274ffcf97a4e5db55bf956186d0e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:23.806509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-18941b46-a48e-4f7b-b444-7be1b09cd9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:23.858077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:23.901360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 649/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:24.192087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f376b6-e5bc-40c8-a406-f778844cd439 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:24.193626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-94f376b6-e5bc-40c8-a406-f778844cd439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:24.203866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:24.298230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f376b6-e5bc-40c8-a406-f778844cd439 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:24.373343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3694f-39b7-4516-b3eb-9703ad22afac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:24.373852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3694f-39b7-4516-b3eb-9703ad22afac service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:24.374134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3694f-39b7-4516-b3eb-9703ad22afac service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:24.374408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3694f-39b7-4516-b3eb-9703ad22afac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:24.376035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-47d3694f-39b7-4516-b3eb-9703ad22afac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:24.439228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:24.487329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3694f-39b7-4516-b3eb-9703ad22afac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:24.488783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3694f-39b7-4516-b3eb-9703ad22afac service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:24.507285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 668/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:27.541308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487788d-d45e-42ef-8bc5-679b04080256 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:27.541866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487788d-d45e-42ef-8bc5-679b04080256 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:27.541866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487788d-d45e-42ef-8bc5-679b04080256 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:27.543140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 650/1318] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:27.548457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4145d-cb57-46c6-bceb-76529b241a06 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:27.548874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4145d-cb57-46c6-bceb-76529b241a06 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:27.549017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4145d-cb57-46c6-bceb-76529b241a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:27.618823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6ba4145d-cb57-46c6-bceb-76529b241a06 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:27.620077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6ba4145d-cb57-46c6-bceb-76529b241a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:27.717286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 669/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:28.000164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487788d-d45e-42ef-8bc5-679b04080256 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:28.001686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e487788d-d45e-42ef-8bc5-679b04080256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:28.105642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487788d-d45e-42ef-8bc5-679b04080256 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:28.180389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601fc4b-98e5-4718-bea8-79ebfcd9a72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:28.180896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601fc4b-98e5-4718-bea8-79ebfcd9a72a service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:28.181173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601fc4b-98e5-4718-bea8-79ebfcd9a72a service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:28.181442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601fc4b-98e5-4718-bea8-79ebfcd9a72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:28.183043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b601fc4b-98e5-4718-bea8-79ebfcd9a72a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:28.189977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:28.291638 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601fc4b-98e5-4718-bea8-79ebfcd9a72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:28.293677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601fc4b-98e5-4718-bea8-79ebfcd9a72a service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:28.311404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 651/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:31.595388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ffd90-e44f-4282-8966-23c9055cf00d None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:31.595990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ffd90-e44f-4282-8966-23c9055cf00d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:31.595990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ffd90-e44f-4282-8966-23c9055cf00d None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:31.597756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 670/1321] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:31.603354 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3de0d-235a-4817-8a5f-ef0ab9cab764 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:31.603902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3de0d-235a-4817-8a5f-ef0ab9cab764 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:31.604007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3de0d-235a-4817-8a5f-ef0ab9cab764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:31.671007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-83c3de0d-235a-4817-8a5f-ef0ab9cab764 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:31.672246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-83c3de0d-235a-4817-8a5f-ef0ab9cab764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:31.734309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:31.778824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 652/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:32.062573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ffd90-e44f-4282-8966-23c9055cf00d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:32.064142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fe8ffd90-e44f-4282-8966-23c9055cf00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:32.084928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:32.180399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ffd90-e44f-4282-8966-23c9055cf00d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:32.256981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9430d9-e2d0-49b6-aa40-fd28a9f0e414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:32.257594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9430d9-e2d0-49b6-aa40-fd28a9f0e414 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:32.257905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9430d9-e2d0-49b6-aa40-fd28a9f0e414 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:32.258142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9430d9-e2d0-49b6-aa40-fd28a9f0e414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:32.259845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cc9430d9-e2d0-49b6-aa40-fd28a9f0e414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:32.331639 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:32.369814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9430d9-e2d0-49b6-aa40-fd28a9f0e414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:32.371834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9430d9-e2d0-49b6-aa40-fd28a9f0e414 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:32.389633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 671/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:34.645579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d72e22-7dde-40e0-8d3b-71929f9eda8f None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:34.646127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d72e22-7dde-40e0-8d3b-71929f9eda8f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:34.646286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d72e22-7dde-40e0-8d3b-71929f9eda8f None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:34.647725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 653/1324] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:34.653601 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539202d-1d80-4099-8f43-2689fc1a51c6 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:34.654171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539202d-1d80-4099-8f43-2689fc1a51c6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:34.654274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539202d-1d80-4099-8f43-2689fc1a51c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:34.721418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-c539202d-1d80-4099-8f43-2689fc1a51c6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:34.722896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c539202d-1d80-4099-8f43-2689fc1a51c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:34.835682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 672/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:35.115412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d72e22-7dde-40e0-8d3b-71929f9eda8f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:35.116994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c2d72e22-7dde-40e0-8d3b-71929f9eda8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:35.229091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d72e22-7dde-40e0-8d3b-71929f9eda8f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:35.318627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556ae1-429b-42e1-b2f0-fe832751f280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:35.319241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556ae1-429b-42e1-b2f0-fe832751f280 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:35.319525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556ae1-429b-42e1-b2f0-fe832751f280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:35.319829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556ae1-429b-42e1-b2f0-fe832751f280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:35.321420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9c556ae1-429b-42e1-b2f0-fe832751f280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:35.340402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:35.444128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c556ae1-429b-42e1-b2f0-fe832751f280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:35.445471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c556ae1-429b-42e1-b2f0-fe832751f280 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:35.470132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 654/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:37.712914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1ad3d-0f8b-437a-816d-69ab901307c0 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:37.713476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1ad3d-0f8b-437a-816d-69ab901307c0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:37.713476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1ad3d-0f8b-437a-816d-69ab901307c0 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:37.715458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 673/1327] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:37.721004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ab92d-1c4b-4fb6-883e-dd906da568b6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:37.721425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ab92d-1c4b-4fb6-883e-dd906da568b6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:37.721539 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ab92d-1c4b-4fb6-883e-dd906da568b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:37.791015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ed5ab92d-1c4b-4fb6-883e-dd906da568b6 None None] MFA Rules not processed for user `a1274ffcf97a4e5db55bf956186d0e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:37.792340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ed5ab92d-1c4b-4fb6-883e-dd906da568b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:37.858172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:37.891955 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 655/1328] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:38.179381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1ad3d-0f8b-437a-816d-69ab901307c0 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:38.180959 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-17a1ad3d-0f8b-437a-816d-69ab901307c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:38.217223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:38.295916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1ad3d-0f8b-437a-816d-69ab901307c0 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:38.381883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780969b-ef20-4e03-a248-a00ac5fec648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:38.382572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780969b-ef20-4e03-a248-a00ac5fec648 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:38.382971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780969b-ef20-4e03-a248-a00ac5fec648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:38.383322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780969b-ef20-4e03-a248-a00ac5fec648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:38.385164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d780969b-ef20-4e03-a248-a00ac5fec648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:38.468156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:38.501208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780969b-ef20-4e03-a248-a00ac5fec648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:38.502631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780969b-ef20-4e03-a248-a00ac5fec648 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:38.520617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 674/1329] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:41.125473 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e35fa-547a-4e18-8a40-092a0d36bfe4 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:41.125984 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e35fa-547a-4e18-8a40-092a0d36bfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:41.126102 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e35fa-547a-4e18-8a40-092a0d36bfe4 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:41.127444 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 656/1330] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:41.132799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55c773-3557-495a-b01c-71ba7a01b8c2 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:41.133261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55c773-3557-495a-b01c-71ba7a01b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:41.133357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55c773-3557-495a-b01c-71ba7a01b8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:41.200615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-7e55c773-3557-495a-b01c-71ba7a01b8c2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:41.201820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7e55c773-3557-495a-b01c-71ba7a01b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:41.296557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 675/1331] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:41.604765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9d550-68ff-4957-9c42-4d6c14694623 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:41.605050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9d550-68ff-4957-9c42-4d6c14694623 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:41.605324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9d550-68ff-4957-9c42-4d6c14694623 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:41.606694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 657/1332] 10.222.0.27 () {54 vars in 965 bytes} [Fri Sep 9 12:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:41.612404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06ebbc-ef46-42e1-91a1-9c84f1adfd0b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:41.612697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06ebbc-ef46-42e1-91a1-9c84f1adfd0b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:41.612973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06ebbc-ef46-42e1-91a1-9c84f1adfd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:41.667463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:41.699094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-1c06ebbc-ef46-42e1-91a1-9c84f1adfd0b None None] MFA Rules not processed for user `88d492b570be4de4b6a6d85f6374ed31`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:41.700431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1c06ebbc-ef46-42e1-91a1-9c84f1adfd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:41.775057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 676/1333] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Sep 9 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:41.784157 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9d550-68ff-4957-9c42-4d6c14694623 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:41.785657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-12c9d550-68ff-4957-9c42-4d6c14694623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:41.888117 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9d550-68ff-4957-9c42-4d6c14694623 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:41.960292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db44889-0c84-4e88-9527-27ff8a05867c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:41.960901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db44889-0c84-4e88-9527-27ff8a05867c service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:41.961185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db44889-0c84-4e88-9527-27ff8a05867c service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:41.961460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db44889-0c84-4e88-9527-27ff8a05867c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:41.963041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5db44889-0c84-4e88-9527-27ff8a05867c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:41.990772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:42.074558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db44889-0c84-4e88-9527-27ff8a05867c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:42.075828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db44889-0c84-4e88-9527-27ff8a05867c service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:42.094824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 658/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:44.533907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c6bd-5752-4834-bba7-a0d1343eb8b4 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:44.534474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c6bd-5752-4834-bba7-a0d1343eb8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:44.534474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c6bd-5752-4834-bba7-a0d1343eb8b4 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:44.535843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 677/1335] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:44.541088 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621049fe-d22d-4358-a4b5-4cc5939e3cca None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:44.541508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621049fe-d22d-4358-a4b5-4cc5939e3cca None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:44.541628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621049fe-d22d-4358-a4b5-4cc5939e3cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:44.609311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-621049fe-d22d-4358-a4b5-4cc5939e3cca None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:44.610537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-621049fe-d22d-4358-a4b5-4cc5939e3cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:44.692229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:44.713673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 659/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:44.999971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c6bd-5752-4834-bba7-a0d1343eb8b4 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:45.001525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6d38c6bd-5752-4834-bba7-a0d1343eb8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:45.102235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c6bd-5752-4834-bba7-a0d1343eb8b4 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:45.133251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:45.177464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf3620-470a-4bf1-84af-b1fd30808d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:45.178065 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3620-470a-4bf1-84af-b1fd30808d14 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:45.178374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3620-470a-4bf1-84af-b1fd30808d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:45.178667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3620-470a-4bf1-84af-b1fd30808d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:45.180272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-addf3620-470a-4bf1-84af-b1fd30808d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:45.286816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf3620-470a-4bf1-84af-b1fd30808d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:45.288118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf3620-470a-4bf1-84af-b1fd30808d14 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:45.306297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 678/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:48.372751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b8ff-d939-476f-8357-78d9f010f0c0 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:48.373335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b8ff-d939-476f-8357-78d9f010f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:48.373335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b8ff-d939-476f-8357-78d9f010f0c0 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:48.374698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 660/1338] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:48.380024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b717960-f68c-4621-a6e4-69e7fc2103ac None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:48.385880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b717960-f68c-4621-a6e4-69e7fc2103ac None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:48.385880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b717960-f68c-4621-a6e4-69e7fc2103ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:48.449243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-1b717960-f68c-4621-a6e4-69e7fc2103ac None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:48.450465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1b717960-f68c-4621-a6e4-69e7fc2103ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:48.458970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:48.550989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 679/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:48.832039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b8ff-d939-476f-8357-78d9f010f0c0 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:48.833568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8416b8ff-d939-476f-8357-78d9f010f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:48.935919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b8ff-d939-476f-8357-78d9f010f0c0 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:49.009570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5c6ce-68de-4e1b-8e91-54a5a6c03084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:49.010175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c6ce-68de-4e1b-8e91-54a5a6c03084 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:49.010457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c6ce-68de-4e1b-8e91-54a5a6c03084 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:49.010730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c6ce-68de-4e1b-8e91-54a5a6c03084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:49.012982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8fc5c6ce-68de-4e1b-8e91-54a5a6c03084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:49.047958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:49.123941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5c6ce-68de-4e1b-8e91-54a5a6c03084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:49.125455 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5c6ce-68de-4e1b-8e91-54a5a6c03084 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:49.144421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 661/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:53.642867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeccfa-a537-48fd-a0de-3e7bba8fd048 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:53.643401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeccfa-a537-48fd-a0de-3e7bba8fd048 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:53.643401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeccfa-a537-48fd-a0de-3e7bba8fd048 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:53.644916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 680/1341] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:53.650347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c567b-fb6b-461a-8b2a-ae3c05eab99b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:53.650830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c567b-fb6b-461a-8b2a-ae3c05eab99b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:53.650955 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c567b-fb6b-461a-8b2a-ae3c05eab99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:53.718367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b05c567b-fb6b-461a-8b2a-ae3c05eab99b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:53.719583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b05c567b-fb6b-461a-8b2a-ae3c05eab99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:53.815344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:53.827472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 662/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:54.106961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeccfa-a537-48fd-a0de-3e7bba8fd048 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:54.108556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a2eeccfa-a537-48fd-a0de-3e7bba8fd048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:54.214871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeccfa-a537-48fd-a0de-3e7bba8fd048 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:54.253793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:54.296158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81763ce-6d84-4435-8c32-06149689d894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:54.296763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81763ce-6d84-4435-8c32-06149689d894 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:54.297039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81763ce-6d84-4435-8c32-06149689d894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:54.297305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81763ce-6d84-4435-8c32-06149689d894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:54.299167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c81763ce-6d84-4435-8c32-06149689d894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:54.409579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81763ce-6d84-4435-8c32-06149689d894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:54.410956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81763ce-6d84-4435-8c32-06149689d894 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:54.430341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 681/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:09:57.565742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec6701-d42d-418b-bba9-1e4c0a059723 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:57.566359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec6701-d42d-418b-bba9-1e4c0a059723 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:57.566359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec6701-d42d-418b-bba9-1e4c0a059723 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:57.567891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 663/1344] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:09:57.573144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90041b6b-ecb9-4c8d-9854-22858fd76e87 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:57.573612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90041b6b-ecb9-4c8d-9854-22858fd76e87 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:57.573834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90041b6b-ecb9-4c8d-9854-22858fd76e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:57.642324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-90041b6b-ecb9-4c8d-9854-22858fd76e87 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:09:57.643522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-90041b6b-ecb9-4c8d-9854-22858fd76e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:57.661512 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:57.742410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 682/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:09:58.036239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec6701-d42d-418b-bba9-1e4c0a059723 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:09:58.037758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-70ec6701-d42d-418b-bba9-1e4c0a059723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:58.150371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec6701-d42d-418b-bba9-1e4c0a059723 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:09:58.225836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7611f-414b-4c01-b9cb-be8de5e420b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:09:58.226340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7611f-414b-4c01-b9cb-be8de5e420b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:09:58.226622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7611f-414b-4c01-b9cb-be8de5e420b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:09:58.226906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7611f-414b-4c01-b9cb-be8de5e420b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:09:58.228526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b5e7611f-414b-4c01-b9cb-be8de5e420b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:09:58.272725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:58.346807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7611f-414b-4c01-b9cb-be8de5e420b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:09:58.348557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7611f-414b-4c01-b9cb-be8de5e420b3 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:09:58.367784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 664/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:09:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:02.754580 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f163386-5859-41b0-ba9e-23e07fa0f6cd None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:02.755147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f163386-5859-41b0-ba9e-23e07fa0f6cd None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:02.755147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f163386-5859-41b0-ba9e-23e07fa0f6cd None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:02.756515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 683/1347] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:02.762306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed1c38-fd5e-4f35-bce8-0e585b8b1b93 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:02.763187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed1c38-fd5e-4f35-bce8-0e585b8b1b93 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:02.763540 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed1c38-fd5e-4f35-bce8-0e585b8b1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:02.834029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b0ed1c38-fd5e-4f35-bce8-0e585b8b1b93 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:02.836737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b0ed1c38-fd5e-4f35-bce8-0e585b8b1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:02.940367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:02.942782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 665/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:03.228452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f163386-5859-41b0-ba9e-23e07fa0f6cd None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:03.229998 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0f163386-5859-41b0-ba9e-23e07fa0f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:03.335311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f163386-5859-41b0-ba9e-23e07fa0f6cd None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:03.383058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:03.408339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2e079-bba0-4d59-9ce2-eee30bf19dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:03.408950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e079-bba0-4d59-9ce2-eee30bf19dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:03.409240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e079-bba0-4d59-9ce2-eee30bf19dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:03.409515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e079-bba0-4d59-9ce2-eee30bf19dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:03.411103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a9f2e079-bba0-4d59-9ce2-eee30bf19dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:03.518384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2e079-bba0-4d59-9ce2-eee30bf19dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:03.520279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2e079-bba0-4d59-9ce2-eee30bf19dc3 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:03.538970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 684/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:08.544246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65090c-f27d-4709-8cb1-5704cb0701a9 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:08.544246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65090c-f27d-4709-8cb1-5704cb0701a9 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:08.544246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65090c-f27d-4709-8cb1-5704cb0701a9 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:08.544991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 666/1350] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:08.549961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268b75-ce8c-47d3-abc3-da10602c8419 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:08.550427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268b75-ce8c-47d3-abc3-da10602c8419 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:08.550592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268b75-ce8c-47d3-abc3-da10602c8419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:08.647067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f7268b75-ce8c-47d3-abc3-da10602c8419 None None] MFA Rules not processed for user `03a4b508dd7048df83f7beeacfe9c085`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:08.648440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f7268b75-ce8c-47d3-abc3-da10602c8419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:08.671569 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:08.804971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 685/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:10:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:13.045114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12cfa0-da5c-45e8-aac1-15ce34611c91 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:13.046031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12cfa0-da5c-45e8-aac1-15ce34611c91 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:13.046453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12cfa0-da5c-45e8-aac1-15ce34611c91 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:13.048037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 667/1352] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:10:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:13.053103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b43d64-609b-4c6a-ae26-7270a2dc83e5 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:13.053548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b43d64-609b-4c6a-ae26-7270a2dc83e5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:13.053786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b43d64-609b-4c6a-ae26-7270a2dc83e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:13.165093 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-67b43d64-609b-4c6a-ae26-7270a2dc83e5 None None] MFA Rules not processed for user `03a4b508dd7048df83f7beeacfe9c085`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:13.166441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-67b43d64-609b-4c6a-ae26-7270a2dc83e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:13.245754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:13.283370 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 686/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:10:14.604618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3252d-ab87-4fe5-b041-0ed314a04d8e None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:14.605218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3252d-ab87-4fe5-b041-0ed314a04d8e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:14.605406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3252d-ab87-4fe5-b041-0ed314a04d8e None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:14.607407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 668/1354] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:14.612658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbe954-e92c-4ef0-afc6-80874fd41ea3 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:14.613083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbe954-e92c-4ef0-afc6-80874fd41ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:14.613217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbe954-e92c-4ef0-afc6-80874fd41ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:14.695514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e6fbe954-e92c-4ef0-afc6-80874fd41ea3 None None] MFA Rules not processed for user `03a4b508dd7048df83f7beeacfe9c085`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:14.696750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e6fbe954-e92c-4ef0-afc6-80874fd41ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:14.802431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 687/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:18.565385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f20c8-ce1a-4978-af37-5c1b94d965e6 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:18.565915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f20c8-ce1a-4978-af37-5c1b94d965e6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:18.565915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f20c8-ce1a-4978-af37-5c1b94d965e6 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:18.567237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 669/1356] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:18.573001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63a8c-9fdb-449d-8363-9c14ca4412a7 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:18.573431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63a8c-9fdb-449d-8363-9c14ca4412a7 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:18.573531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63a8c-9fdb-449d-8363-9c14ca4412a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:18.613669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:18.649682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-39c63a8c-9fdb-449d-8363-9c14ca4412a7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:18.650876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-39c63a8c-9fdb-449d-8363-9c14ca4412a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:18.756050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 688/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:19.064542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932180e-b86a-484a-b8ed-c9b6687dfb06 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:19.065692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932180e-b86a-484a-b8ed-c9b6687dfb06 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:19.066281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932180e-b86a-484a-b8ed-c9b6687dfb06 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:19.068345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 670/1358] 10.222.0.27 () {54 vars in 962 bytes} [Fri Sep 9 12:10:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:19.077706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14281-bf45-48ed-bd5a-01190e9c750b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:19.078478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14281-bf45-48ed-bd5a-01190e9c750b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:19.079239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14281-bf45-48ed-bd5a-01190e9c750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:19.167832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-adc14281-bf45-48ed-bd5a-01190e9c750b None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:19.169602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-adc14281-bf45-48ed-bd5a-01190e9c750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:19.221427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:19.294689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 689/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Sep 9 12:10:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:10:19.302369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932180e-b86a-484a-b8ed-c9b6687dfb06 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:19.303903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0932180e-b86a-484a-b8ed-c9b6687dfb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:19.469969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932180e-b86a-484a-b8ed-c9b6687dfb06 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:19.547248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:19.587099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b85ff-a840-4efd-820f-29f393e3ca52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:19.587844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b85ff-a840-4efd-820f-29f393e3ca52 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:19.588094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b85ff-a840-4efd-820f-29f393e3ca52 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:19.588276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b85ff-a840-4efd-820f-29f393e3ca52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:19.589867 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-366b85ff-a840-4efd-820f-29f393e3ca52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:19.693354 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b85ff-a840-4efd-820f-29f393e3ca52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:19.695229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b85ff-a840-4efd-820f-29f393e3ca52 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:19.716666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 671/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:22.271099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e26a-d275-4cf4-96d5-47abaa7fc675 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:22.271665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e26a-d275-4cf4-96d5-47abaa7fc675 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:22.271665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e26a-d275-4cf4-96d5-47abaa7fc675 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:22.273290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 690/1361] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:22.279231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ac47a-ea56-4cda-b5b7-3c6644ac77c2 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:22.279787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ac47a-ea56-4cda-b5b7-3c6644ac77c2 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:22.279787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ac47a-ea56-4cda-b5b7-3c6644ac77c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:22.353880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-cb1ac47a-ea56-4cda-b5b7-3c6644ac77c2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:22.355237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cb1ac47a-ea56-4cda-b5b7-3c6644ac77c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:22.396016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:22.470550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 672/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:22.773047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537e26a-d275-4cf4-96d5-47abaa7fc675 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:22.774595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a537e26a-d275-4cf4-96d5-47abaa7fc675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:22.971058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537e26a-d275-4cf4-96d5-47abaa7fc675 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:22.982139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:23.100229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9673b4-a922-413d-9228-fd9e98e6559e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:23.100757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9673b4-a922-413d-9228-fd9e98e6559e service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:23.101033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9673b4-a922-413d-9228-fd9e98e6559e service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:23.101312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9673b4-a922-413d-9228-fd9e98e6559e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:23.102929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ee9673b4-a922-413d-9228-fd9e98e6559e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:23.200857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9673b4-a922-413d-9228-fd9e98e6559e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:23.202457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9673b4-a922-413d-9228-fd9e98e6559e service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:23.221016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 691/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:25.883728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94930445-3dff-4f71-9369-ddaeb866cf05 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:25.884310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94930445-3dff-4f71-9369-ddaeb866cf05 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:25.884310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94930445-3dff-4f71-9369-ddaeb866cf05 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:25.885613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 673/1364] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:25.891323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d1900-9a7a-4da8-b8c7-90c3afb1d245 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:25.891830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d1900-9a7a-4da8-b8c7-90c3afb1d245 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:25.891927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d1900-9a7a-4da8-b8c7-90c3afb1d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:25.908252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:25.961261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e99d1900-9a7a-4da8-b8c7-90c3afb1d245 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:25.962481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e99d1900-9a7a-4da8-b8c7-90c3afb1d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:26.071380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 692/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:26.379325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a9d2b-17d9-43ce-9a79-c339f1281b37 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:26.380016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a9d2b-17d9-43ce-9a79-c339f1281b37 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:26.380586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a9d2b-17d9-43ce-9a79-c339f1281b37 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:26.382212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 674/1366] 10.222.0.27 () {54 vars in 962 bytes} [Fri Sep 9 12:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:26.388324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1b0f-23ba-4a46-956a-a0547b4295c4 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:26.392227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1b0f-23ba-4a46-956a-a0547b4295c4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:26.392227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1b0f-23ba-4a46-956a-a0547b4295c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:26.470840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ce6d1b0f-23ba-4a46-956a-a0547b4295c4 None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:26.472093 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ce6d1b0f-23ba-4a46-956a-a0547b4295c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:26.510528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:26.595209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 693/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Sep 9 12:10:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:26.603344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a9d2b-17d9-43ce-9a79-c339f1281b37 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:26.604987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c15a9d2b-17d9-43ce-9a79-c339f1281b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:26.761656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a9d2b-17d9-43ce-9a79-c339f1281b37 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:26.784102 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:26.888937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807f204-33f8-4aa2-b2c6-7a0b65ad58bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:26.889659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807f204-33f8-4aa2-b2c6-7a0b65ad58bc service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:26.889798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807f204-33f8-4aa2-b2c6-7a0b65ad58bc service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:26.890085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807f204-33f8-4aa2-b2c6-7a0b65ad58bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:26.891703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f807f204-33f8-4aa2-b2c6-7a0b65ad58bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:26.956259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a69f5-ef91-4522-bec8-1d0c45e6fd13 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:26.956832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a69f5-ef91-4522-bec8-1d0c45e6fd13 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:26.956832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a69f5-ef91-4522-bec8-1d0c45e6fd13 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:26.962342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 694/1368] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 12:10:26.963522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c217c1d-92e4-4d11-bc2b-d203ba665057 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:26.963839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c217c1d-92e4-4d11-bc2b-d203ba665057 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:26.964127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c217c1d-92e4-4d11-bc2b-d203ba665057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:26.989159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807f204-33f8-4aa2-b2c6-7a0b65ad58bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:26.990749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807f204-33f8-4aa2-b2c6-7a0b65ad58bc service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:27.010800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 675/1369] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:27.036948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2c217c1d-92e4-4d11-bc2b-d203ba665057 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:27.038203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2c217c1d-92e4-4d11-bc2b-d203ba665057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:27.142633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:27.149854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 695/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:27.505468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bae37-f393-4e63-947c-c26cae5e5d83 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:27.505760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bae37-f393-4e63-947c-c26cae5e5d83 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:27.506038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bae37-f393-4e63-947c-c26cae5e5d83 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:27.508059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 676/1371] 10.222.0.27 () {54 vars in 964 bytes} [Fri Sep 9 12:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:27.512987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbb494-bf2e-49a9-91d0-4f857b5a0bab None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:27.513409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbb494-bf2e-49a9-91d0-4f857b5a0bab None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:27.513783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbb494-bf2e-49a9-91d0-4f857b5a0bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:27.600286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-a3dbb494-bf2e-49a9-91d0-4f857b5a0bab None None] MFA Rules not processed for user `6ce95a25d894457d8cd45c30b38f014e`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:27.601570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a3dbb494-bf2e-49a9-91d0-4f857b5a0bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:27.687284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 696/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Sep 9 12:10:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:27.695107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bae37-f393-4e63-947c-c26cae5e5d83 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:27.696855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-397bae37-f393-4e63-947c-c26cae5e5d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:27.745944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:27.829936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bae37-f393-4e63-947c-c26cae5e5d83 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:27.919436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91501a12-2105-49ba-bbbc-b00bf59709b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:27.920201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501a12-2105-49ba-bbbc-b00bf59709b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:27.920585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501a12-2105-49ba-bbbc-b00bf59709b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:27.920866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501a12-2105-49ba-bbbc-b00bf59709b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:27.922491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-91501a12-2105-49ba-bbbc-b00bf59709b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:28.023777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:28.057567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91501a12-2105-49ba-bbbc-b00bf59709b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:28.059037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91501a12-2105-49ba-bbbc-b00bf59709b1 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:28.077804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 677/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:29.514169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8df7-eb2e-4419-92aa-3be7d318a82d None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:29.514698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8df7-eb2e-4419-92aa-3be7d318a82d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:29.514801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8df7-eb2e-4419-92aa-3be7d318a82d None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:29.516118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 697/1374] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:29.521375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d78fbb-f728-488f-aad6-5f0a1e70e587 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:29.521816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d78fbb-f728-488f-aad6-5f0a1e70e587 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:29.521924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d78fbb-f728-488f-aad6-5f0a1e70e587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:29.588076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-68d78fbb-f728-488f-aad6-5f0a1e70e587 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:29.589306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-68d78fbb-f728-488f-aad6-5f0a1e70e587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:29.688589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 678/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:29.984540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a8df7-eb2e-4419-92aa-3be7d318a82d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:29.986089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cb1a8df7-eb2e-4419-92aa-3be7d318a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:30.080987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:30.148493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a8df7-eb2e-4419-92aa-3be7d318a82d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:30.291857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e82d3-c5e7-4896-b946-a22c633b9abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:30.292540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e82d3-c5e7-4896-b946-a22c633b9abe service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:30.293888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e82d3-c5e7-4896-b946-a22c633b9abe service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:30.293888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e82d3-c5e7-4896-b946-a22c633b9abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:30.295472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8d9e82d3-c5e7-4896-b946-a22c633b9abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:30.350065 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:30.396793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e82d3-c5e7-4896-b946-a22c633b9abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:30.397541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e82d3-c5e7-4896-b946-a22c633b9abe service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:30.417588 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 698/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:32.846982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715fcc3-f769-4d5d-8b71-4259a9fd54ea None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:32.847520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715fcc3-f769-4d5d-8b71-4259a9fd54ea None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:32.847520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715fcc3-f769-4d5d-8b71-4259a9fd54ea None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:32.849456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 679/1377] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:32.854642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985675-2f44-425c-a012-9ee74d0b7182 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:32.855054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985675-2f44-425c-a012-9ee74d0b7182 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:32.855224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985675-2f44-425c-a012-9ee74d0b7182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:32.923914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-57985675-2f44-425c-a012-9ee74d0b7182 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:32.925103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-57985675-2f44-425c-a012-9ee74d0b7182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:33.027290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 699/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:33.321732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715fcc3-f769-4d5d-8b71-4259a9fd54ea None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:33.323523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8715fcc3-f769-4d5d-8b71-4259a9fd54ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:33.365952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:33.493441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715fcc3-f769-4d5d-8b71-4259a9fd54ea None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:33.610335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:33.615877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7e4b1-c3a3-405b-9b9d-589191f90ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:33.616649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7e4b1-c3a3-405b-9b9d-589191f90ce7 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:33.624042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7e4b1-c3a3-405b-9b9d-589191f90ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:33.624042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7e4b1-c3a3-405b-9b9d-589191f90ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:33.624042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8cf7e4b1-c3a3-405b-9b9d-589191f90ce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:33.717088 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7e4b1-c3a3-405b-9b9d-589191f90ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:33.718881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7e4b1-c3a3-405b-9b9d-589191f90ce7 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:33.738931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 680/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:36.074204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241bcba-794d-4103-9762-775faad29d8a None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:36.075278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241bcba-794d-4103-9762-775faad29d8a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:36.075278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241bcba-794d-4103-9762-775faad29d8a None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:36.076676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 700/1380] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 12:10:36.082266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d121-bd51-403a-9574-56bf61f707d3 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:36.082886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d121-bd51-403a-9574-56bf61f707d3 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:36.082886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d121-bd51-403a-9574-56bf61f707d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:36.158179 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d0a1d121-bd51-403a-9574-56bf61f707d3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:36.159453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d0a1d121-bd51-403a-9574-56bf61f707d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:36.240678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:36.274901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 681/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:36.580687 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241bcba-794d-4103-9762-775faad29d8a None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:36.582231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f241bcba-794d-4103-9762-775faad29d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:36.612593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:36.750973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241bcba-794d-4103-9762-775faad29d8a None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:36.851036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:36.867840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50045a-a8d6-4e81-9745-dec2552ec41d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:36.868452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50045a-a8d6-4e81-9745-dec2552ec41d service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:36.868732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50045a-a8d6-4e81-9745-dec2552ec41d service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:36.869002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50045a-a8d6-4e81-9745-dec2552ec41d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:36.870613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3d50045a-a8d6-4e81-9745-dec2552ec41d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:36.961046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50045a-a8d6-4e81-9745-dec2552ec41d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:36.962649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50045a-a8d6-4e81-9745-dec2552ec41d service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:36.981796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 701/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:10:39.353891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e808ff-bf52-4c2c-af52-c6965d61cc2c None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:39.354454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e808ff-bf52-4c2c-af52-c6965d61cc2c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:39.354454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e808ff-bf52-4c2c-af52-c6965d61cc2c None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:39.355843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 682/1383] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:39.361535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325a02-7109-40e9-bb7e-ad186a85ed6c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:39.361987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325a02-7109-40e9-bb7e-ad186a85ed6c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:39.362082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325a02-7109-40e9-bb7e-ad186a85ed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:39.429933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-1c325a02-7109-40e9-bb7e-ad186a85ed6c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:39.431039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1c325a02-7109-40e9-bb7e-ad186a85ed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:39.492000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:39.532756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 702/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:39.821189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e808ff-bf52-4c2c-af52-c6965d61cc2c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:39.823182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e8e808ff-bf52-4c2c-af52-c6965d61cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:39.983369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e808ff-bf52-4c2c-af52-c6965d61cc2c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:40.046043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:40.128885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f703d-c29f-494b-8424-72893656222f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:40.129504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f703d-c29f-494b-8424-72893656222f service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:40.129783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f703d-c29f-494b-8424-72893656222f service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:40.130055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f703d-c29f-494b-8424-72893656222f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:40.131687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-342f703d-c29f-494b-8424-72893656222f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:40.228323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f703d-c29f-494b-8424-72893656222f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:40.229830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f703d-c29f-494b-8424-72893656222f service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:40.251575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 683/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:42.456610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53f82-7f4c-47a7-a199-3389fcbcd20a None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:42.457180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53f82-7f4c-47a7-a199-3389fcbcd20a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:42.457180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53f82-7f4c-47a7-a199-3389fcbcd20a None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:42.458530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 703/1386] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:42.464107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f6bdd-b2be-4625-9247-c8bba77762f6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:42.464548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f6bdd-b2be-4625-9247-c8bba77762f6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:42.464737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f6bdd-b2be-4625-9247-c8bba77762f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:42.533563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-666f6bdd-b2be-4625-9247-c8bba77762f6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:42.534816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-666f6bdd-b2be-4625-9247-c8bba77762f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:42.544466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:42.634967 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 684/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:42.937600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b53f82-7f4c-47a7-a199-3389fcbcd20a None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:42.939166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e8b53f82-7f4c-47a7-a199-3389fcbcd20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:43.220426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b53f82-7f4c-47a7-a199-3389fcbcd20a None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:43.270655 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:43.349143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d1649-9ee7-43ab-84e2-9e4b50ad2043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:43.349766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d1649-9ee7-43ab-84e2-9e4b50ad2043 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:43.350543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d1649-9ee7-43ab-84e2-9e4b50ad2043 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:43.350543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d1649-9ee7-43ab-84e2-9e4b50ad2043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:43.353647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-001d1649-9ee7-43ab-84e2-9e4b50ad2043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:43.467249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d1649-9ee7-43ab-84e2-9e4b50ad2043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:43.468826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d1649-9ee7-43ab-84e2-9e4b50ad2043 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:43.491067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 704/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:43.733783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d29df-c5aa-4ec0-b7dd-dd966450faf6 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:43.734263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d29df-c5aa-4ec0-b7dd-dd966450faf6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:43.734383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d29df-c5aa-4ec0-b7dd-dd966450faf6 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:43.735677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 685/1389] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:43.741108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72624e20-e05b-488e-80d2-01a661e7b502 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:43.741471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72624e20-e05b-488e-80d2-01a661e7b502 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:43.741820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72624e20-e05b-488e-80d2-01a661e7b502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:43.805379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:43.808629 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-72624e20-e05b-488e-80d2-01a661e7b502 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:43.810036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-72624e20-e05b-488e-80d2-01a661e7b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:43.919633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 705/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:44.224355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502c709-1ab6-43d0-86fa-edd38f2f12c8 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:44.224642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502c709-1ab6-43d0-86fa-edd38f2f12c8 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:44.224923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502c709-1ab6-43d0-86fa-edd38f2f12c8 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:44.226274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 686/1391] 10.222.0.27 () {54 vars in 966 bytes} [Fri Sep 9 12:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:44.232287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cfd85-5908-48a6-a142-7c98bcfaffa6 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:44.232650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cfd85-5908-48a6-a142-7c98bcfaffa6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:44.233012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cfd85-5908-48a6-a142-7c98bcfaffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:44.310744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-086cfd85-5908-48a6-a142-7c98bcfaffa6 None None] MFA Rules not processed for user `decb5421872c4034bbbaa8c3cd9dcb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:44.311986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-086cfd85-5908-48a6-a142-7c98bcfaffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:44.382112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:44.388196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 706/1392] 10.222.0.27 () {58 vars in 1063 bytes} [Fri Sep 9 12:10:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:44.400584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502c709-1ab6-43d0-86fa-edd38f2f12c8 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:44.402072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7502c709-1ab6-43d0-86fa-edd38f2f12c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:44.523347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502c709-1ab6-43d0-86fa-edd38f2f12c8 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:44.566433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:44.603690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f137dd2-0b7c-4233-9fa7-f1e09fc97c59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'decb5421872c4034bbbaa8c3cd9dcb5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:44.605704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137dd2-0b7c-4233-9fa7-f1e09fc97c59 service glance] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:44.605704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137dd2-0b7c-4233-9fa7-f1e09fc97c59 service glance] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:44.605704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137dd2-0b7c-4233-9fa7-f1e09fc97c59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:44.607253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3f137dd2-0b7c-4233-9fa7-f1e09fc97c59 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:44.723443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f137dd2-0b7c-4233-9fa7-f1e09fc97c59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:44.724826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f137dd2-0b7c-4233-9fa7-f1e09fc97c59 service glance] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:44.743367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 687/1393] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:45.624664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507582e-fb43-4ea7-9b7d-29a9f3f30421 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:45.625260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507582e-fb43-4ea7-9b7d-29a9f3f30421 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:45.625260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507582e-fb43-4ea7-9b7d-29a9f3f30421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:45.697815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3507582e-fb43-4ea7-9b7d-29a9f3f30421 None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:45.699983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3507582e-fb43-4ea7-9b7d-29a9f3f30421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:45.799270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 707/1394] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:10:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:45.849915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f4bd1-f620-4099-9fec-cecf179c1f46 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:45.850485 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f4bd1-f620-4099-9fec-cecf179c1f46 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:45.850485 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f4bd1-f620-4099-9fec-cecf179c1f46 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:45.851822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 688/1395] 10.222.0.27 () {54 vars in 943 bytes} [Fri Sep 9 12:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:45.859286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a30e-e789-4c2f-97ad-87223f648950 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:45.859573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a30e-e789-4c2f-97ad-87223f648950 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:45.859874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a30e-e789-4c2f-97ad-87223f648950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:45.943003 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9899a30e-e789-4c2f-97ad-87223f648950 None None] MFA Rules not processed for user `063f7bf74f444c14b9bf6c0ca936dd12`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:45.944225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9899a30e-e789-4c2f-97ad-87223f648950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:45.971134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:45.997639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc14f2-4772-4393-9a6b-fde6021681cd None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:45.997950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc14f2-4772-4393-9a6b-fde6021681cd None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:45.998228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc14f2-4772-4393-9a6b-fde6021681cd None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:45.999586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 689/1396] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 12:10:46.004809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dae36-ef8f-48a5-bb0b-33a9db5ddb6e None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:46.005168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dae36-ef8f-48a5-bb0b-33a9db5ddb6e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:46.005517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dae36-ef8f-48a5-bb0b-33a9db5ddb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:46.051037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 708/1397] 10.222.0.27 () {58 vars in 1040 bytes} [Fri Sep 9 12:10:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:46.060376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a30e-e789-4c2f-97ad-87223f648950 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:46.072787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a30e-e789-4c2f-97ad-87223f648950 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:46.078542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-5d7dae36-ef8f-48a5-bb0b-33a9db5ddb6e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:46.079813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5d7dae36-ef8f-48a5-bb0b-33a9db5ddb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:46.099488 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:46.194707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb3c64-29d0-472a-86ea-f15ce992dcc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:46.195339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb3c64-29d0-472a-86ea-f15ce992dcc5 service swift] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:46.198296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 690/1398] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:46.198494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb3c64-29d0-472a-86ea-f15ce992dcc5 service swift] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:46.198494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb3c64-29d0-472a-86ea-f15ce992dcc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:46.198494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-21fb3c64-29d0-472a-86ea-f15ce992dcc5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:46.234269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:46.283125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb3c64-29d0-472a-86ea-f15ce992dcc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:46.284724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb3c64-29d0-472a-86ea-f15ce992dcc5 service swift] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:46.292643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 709/1399] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:10:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 12:10:46.488609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dae36-ef8f-48a5-bb0b-33a9db5ddb6e None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:46.489827 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5d7dae36-ef8f-48a5-bb0b-33a9db5ddb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:46.606430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dae36-ef8f-48a5-bb0b-33a9db5ddb6e None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:46.644957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:46.722523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25880211-574c-4f06-aa45-1e8278ef0572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:46.723389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25880211-574c-4f06-aa45-1e8278ef0572 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:46.723701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25880211-574c-4f06-aa45-1e8278ef0572 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:46.723979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25880211-574c-4f06-aa45-1e8278ef0572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:46.725563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-25880211-574c-4f06-aa45-1e8278ef0572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:46.839414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25880211-574c-4f06-aa45-1e8278ef0572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:46.841133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25880211-574c-4f06-aa45-1e8278ef0572 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:46.860489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 691/1400] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:49.224402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98d424-174f-4402-99fc-b306a4b19145 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:49.225602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98d424-174f-4402-99fc-b306a4b19145 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:49.225949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98d424-174f-4402-99fc-b306a4b19145 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:49.230361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 710/1401] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:49.234295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85327-8a06-4314-913d-bd2673acc0b8 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:49.234763 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85327-8a06-4314-913d-bd2673acc0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:49.235029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85327-8a06-4314-913d-bd2673acc0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:49.298437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:49.319076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-25b85327-8a06-4314-913d-bd2673acc0b8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:49.320374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-25b85327-8a06-4314-913d-bd2673acc0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:49.450314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 692/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:49.745205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98d424-174f-4402-99fc-b306a4b19145 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:49.747248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fd98d424-174f-4402-99fc-b306a4b19145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:49.907687 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98d424-174f-4402-99fc-b306a4b19145 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:49.938348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:50.038525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970830a-3a9f-44ca-b0cd-ed9be9151190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:50.039060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970830a-3a9f-44ca-b0cd-ed9be9151190 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:50.039341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970830a-3a9f-44ca-b0cd-ed9be9151190 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:50.039739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970830a-3a9f-44ca-b0cd-ed9be9151190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:50.041277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9970830a-3a9f-44ca-b0cd-ed9be9151190 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:50.141846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970830a-3a9f-44ca-b0cd-ed9be9151190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:50.142631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970830a-3a9f-44ca-b0cd-ed9be9151190 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:50.162022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 711/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:52.547023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a91f3-eef0-4430-a043-045de3298297 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:52.547609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a91f3-eef0-4430-a043-045de3298297 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:52.547609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a91f3-eef0-4430-a043-045de3298297 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:52.548963 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 693/1404] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:52.554591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97575b-8268-4e66-86a3-66f3c7d6786f None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:52.555096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97575b-8268-4e66-86a3-66f3c7d6786f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:52.555197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97575b-8268-4e66-86a3-66f3c7d6786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:52.605502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:52.633306 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4c97575b-8268-4e66-86a3-66f3c7d6786f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:52.634542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4c97575b-8268-4e66-86a3-66f3c7d6786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:52.758367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 712/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:10:53.047801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a91f3-eef0-4430-a043-045de3298297 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:53.049307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-181a91f3-eef0-4430-a043-045de3298297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:53.183558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:53.220765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a91f3-eef0-4430-a043-045de3298297 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:53.349746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042fbd2-3ec9-41ce-959e-a3224df92b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:53.350370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042fbd2-3ec9-41ce-959e-a3224df92b82 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:53.350653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042fbd2-3ec9-41ce-959e-a3224df92b82 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:53.350928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042fbd2-3ec9-41ce-959e-a3224df92b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:53.352640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4042fbd2-3ec9-41ce-959e-a3224df92b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:53.445851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:53.457589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042fbd2-3ec9-41ce-959e-a3224df92b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:53.459214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042fbd2-3ec9-41ce-959e-a3224df92b82 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:53.479457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 694/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:10:55.836472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7f30b-ec09-4299-a651-571404a66c69 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:55.837017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7f30b-ec09-4299-a651-571404a66c69 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:55.837017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7f30b-ec09-4299-a651-571404a66c69 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:55.838269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 713/1407] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:10:55.843855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf333f-1858-4a9e-a935-82a78b0a8430 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:55.844727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf333f-1858-4a9e-a935-82a78b0a8430 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:55.845166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf333f-1858-4a9e-a935-82a78b0a8430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:55.921897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-fedf333f-1858-4a9e-a935-82a78b0a8430 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:10:55.923139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-fedf333f-1858-4a9e-a935-82a78b0a8430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:56.037275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 695/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:10:56.343279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7f30b-ec09-4299-a651-571404a66c69 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:10:56.345054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fad7f30b-ec09-4299-a651-571404a66c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:56.461540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:56.506779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7f30b-ec09-4299-a651-571404a66c69 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:10:56.649636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510048e-d1da-42a3-875c-26aa6d43d219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:10:56.650262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510048e-d1da-42a3-875c-26aa6d43d219 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:10:56.650539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510048e-d1da-42a3-875c-26aa6d43d219 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:10:56.650849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510048e-d1da-42a3-875c-26aa6d43d219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:10:56.652505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4510048e-d1da-42a3-875c-26aa6d43d219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:10:56.739794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:56.759595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510048e-d1da-42a3-875c-26aa6d43d219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:10:56.761368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510048e-d1da-42a3-875c-26aa6d43d219 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:10:56.781950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 714/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:06.035639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=74 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:06.779516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=13 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:11.271981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889b8d3-13f9-4566-9b76-0f5c0c2753a7 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:11.272556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889b8d3-13f9-4566-9b76-0f5c0c2753a7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:11.272556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889b8d3-13f9-4566-9b76-0f5c0c2753a7 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:11.273870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 696/1410] 10.222.0.27 () {54 vars in 918 bytes} [Fri Sep 9 12:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:11.279171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a79521-9e73-471c-b545-de092f8e9a6a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:11.279600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a79521-9e73-471c-b545-de092f8e9a6a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:11.279747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a79521-9e73-471c-b545-de092f8e9a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:11.366777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-72a79521-9e73-471c-b545-de092f8e9a6a None None] MFA Rules not processed for user `03a4b508dd7048df83f7beeacfe9c085`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:11.367991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-72a79521-9e73-471c-b545-de092f8e9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:11.473749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 715/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Sep 9 12:11:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:11.488906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a5b3-6faa-4c1d-abf2-34f220f0549d None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:11.489176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a5b3-6faa-4c1d-abf2-34f220f0549d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:11.489450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a5b3-6faa-4c1d-abf2-34f220f0549d None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:11.490794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 697/1412] 10.222.0.27 () {54 vars in 918 bytes} [Fri Sep 9 12:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:11.496241 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771fc65-627c-4ba7-a4fb-d91fa708de53 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:11.496572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771fc65-627c-4ba7-a4fb-d91fa708de53 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:11.496853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771fc65-627c-4ba7-a4fb-d91fa708de53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:11.575184 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:11.577830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9771fc65-627c-4ba7-a4fb-d91fa708de53 None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:11.579035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9771fc65-627c-4ba7-a4fb-d91fa708de53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:11.697587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 716/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Sep 9 12:11:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:14.302800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a3026-f4ef-41fd-8e80-044df248fdfd None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:14.303325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a3026-f4ef-41fd-8e80-044df248fdfd None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:14.303325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a3026-f4ef-41fd-8e80-044df248fdfd None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:14.304668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:14.310156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58751023-b7b1-4b8e-afff-538cfb1d39bd None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:14.310591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58751023-b7b1-4b8e-afff-538cfb1d39bd None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:14.310714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58751023-b7b1-4b8e-afff-538cfb1d39bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:14.378735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-58751023-b7b1-4b8e-afff-538cfb1d39bd None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:14.379983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-58751023-b7b1-4b8e-afff-538cfb1d39bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:14.442023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:14.485431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:14.780235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a3026-f4ef-41fd-8e80-044df248fdfd None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:14.781747 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-225a3026-f4ef-41fd-8e80-044df248fdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:14.928439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a3026-f4ef-41fd-8e80-044df248fdfd None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:15.000384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:15.041027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cf462-ba1c-4319-9b24-f59d75af8b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:15.041634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cf462-ba1c-4319-9b24-f59d75af8b43 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:15.041912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cf462-ba1c-4319-9b24-f59d75af8b43 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:15.042184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cf462-ba1c-4319-9b24-f59d75af8b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:15.044300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3d4cf462-ba1c-4319-9b24-f59d75af8b43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:15.136854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cf462-ba1c-4319-9b24-f59d75af8b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:15.138508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cf462-ba1c-4319-9b24-f59d75af8b43 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:15.156436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 699/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:16.312689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca2f32-50a3-44ec-ac6a-a020ac0d15ac None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:16.313217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca2f32-50a3-44ec-ac6a-a020ac0d15ac None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:16.313217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca2f32-50a3-44ec-ac6a-a020ac0d15ac None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:16.314501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:16.320883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0662f2-d103-45a4-8b91-c9ec8e7a98c5 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:16.321361 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0662f2-d103-45a4-8b91-c9ec8e7a98c5 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:16.321473 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0662f2-d103-45a4-8b91-c9ec8e7a98c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:16.399041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ac0662f2-d103-45a4-8b91-c9ec8e7a98c5 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:16.400295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ac0662f2-d103-45a4-8b91-c9ec8e7a98c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:16.427179 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:16.497226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:16.648509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca2f32-50a3-44ec-ac6a-a020ac0d15ac None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:16.650049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4cca2f32-50a3-44ec-ac6a-a020ac0d15ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:16.810718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca2f32-50a3-44ec-ac6a-a020ac0d15ac None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:16.850551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:16.921567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fe06c-3302-46f5-897b-144b9801defb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:16.922070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fe06c-3302-46f5-897b-144b9801defb service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:16.922350 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fe06c-3302-46f5-897b-144b9801defb service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:16.922617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fe06c-3302-46f5-897b-144b9801defb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:16.924199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-593fe06c-3302-46f5-897b-144b9801defb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:17.020250 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fe06c-3302-46f5-897b-144b9801defb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:17.023507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fe06c-3302-46f5-897b-144b9801defb service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:17.041140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 719/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:18.187025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804455ed-7f60-4021-bc42-9893792d7093 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:18.187581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804455ed-7f60-4021-bc42-9893792d7093 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:18.187581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804455ed-7f60-4021-bc42-9893792d7093 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:18.189303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:18.195945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced47f6-d60c-4842-b5e8-1ed59065ad58 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:18.196470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced47f6-d60c-4842-b5e8-1ed59065ad58 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:18.196671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced47f6-d60c-4842-b5e8-1ed59065ad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:18.254006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:18.283331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-bced47f6-d60c-4842-b5e8-1ed59065ad58 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:18.284600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bced47f6-d60c-4842-b5e8-1ed59065ad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:18.383117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:11:18.536768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804455ed-7f60-4021-bc42-9893792d7093 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:18.538244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-804455ed-7f60-4021-bc42-9893792d7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:18.687193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804455ed-7f60-4021-bc42-9893792d7093 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:18.699841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:18.799341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62533b7b-b3cc-49bf-b488-a422ea59221f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:18.799882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533b7b-b3cc-49bf-b488-a422ea59221f service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:18.800160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533b7b-b3cc-49bf-b488-a422ea59221f service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:18.800428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533b7b-b3cc-49bf-b488-a422ea59221f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:18.801995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-62533b7b-b3cc-49bf-b488-a422ea59221f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:18.889535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533b7b-b3cc-49bf-b488-a422ea59221f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:18.899429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533b7b-b3cc-49bf-b488-a422ea59221f service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:18.909607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 702/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:20.038243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc4a9-5788-44cc-bedd-cb845adc3d25 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:20.038753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc4a9-5788-44cc-bedd-cb845adc3d25 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:20.038851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc4a9-5788-44cc-bedd-cb845adc3d25 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:20.040239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:20.047430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6996d-b004-4afd-808e-5e9824871c3a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:20.047973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6996d-b004-4afd-808e-5e9824871c3a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:20.048084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6996d-b004-4afd-808e-5e9824871c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:20.067960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:20.125529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-cef6996d-b004-4afd-808e-5e9824871c3a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:20.126726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cef6996d-b004-4afd-808e-5e9824871c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:20.225716 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:20.386581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc4a9-5788-44cc-bedd-cb845adc3d25 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:20.388390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8f1cc4a9-5788-44cc-bedd-cb845adc3d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:20.505271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:20.540575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc4a9-5788-44cc-bedd-cb845adc3d25 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:20.658385 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12970524-5757-46c4-b0ee-0c9c83212b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:20.659041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970524-5757-46c4-b0ee-0c9c83212b36 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:20.659319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970524-5757-46c4-b0ee-0c9c83212b36 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:20.659590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970524-5757-46c4-b0ee-0c9c83212b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:20.661183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-12970524-5757-46c4-b0ee-0c9c83212b36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:20.738635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:20.752053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12970524-5757-46c4-b0ee-0c9c83212b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:20.753615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12970524-5757-46c4-b0ee-0c9c83212b36 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:20.771603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 722/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:21.889813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c2598-6d7b-48c4-8665-f99b1d7ca27f None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:21.890369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c2598-6d7b-48c4-8665-f99b1d7ca27f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:21.890484 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c2598-6d7b-48c4-8665-f99b1d7ca27f None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:21.891739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 12:11:21.898064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d7161-9323-47b7-8a9e-b2fb089f7341 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:21.898527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d7161-9323-47b7-8a9e-b2fb089f7341 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:21.898622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d7161-9323-47b7-8a9e-b2fb089f7341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:21.974069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4f5d7161-9323-47b7-8a9e-b2fb089f7341 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:21.975280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4f5d7161-9323-47b7-8a9e-b2fb089f7341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:22.070661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:22.222654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c2598-6d7b-48c4-8665-f99b1d7ca27f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:22.224428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0a0c2598-6d7b-48c4-8665-f99b1d7ca27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:22.311099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:22.373860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c2598-6d7b-48c4-8665-f99b1d7ca27f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:22.487754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb7705-48e0-4290-b3a4-791907e2eb85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:22.488272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb7705-48e0-4290-b3a4-791907e2eb85 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:22.488555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb7705-48e0-4290-b3a4-791907e2eb85 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:22.488830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb7705-48e0-4290-b3a4-791907e2eb85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:22.490440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e7bb7705-48e0-4290-b3a4-791907e2eb85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:22.539521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:22.579782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb7705-48e0-4290-b3a4-791907e2eb85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:22.581391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb7705-48e0-4290-b3a4-791907e2eb85 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:22.600470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 705/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:23.872598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75dba-3cef-4279-804d-037d45855bb3 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:23.873719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75dba-3cef-4279-804d-037d45855bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:23.873719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75dba-3cef-4279-804d-037d45855bb3 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:23.875058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:23.881530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c64de4-072b-469c-832a-8af854d5a8ad None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:23.881976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c64de4-072b-469c-832a-8af854d5a8ad None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:23.882068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c64de4-072b-469c-832a-8af854d5a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:23.957460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-c3c64de4-072b-469c-832a-8af854d5a8ad None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:23.958720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c3c64de4-072b-469c-832a-8af854d5a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:24.055996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:24.208293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75dba-3cef-4279-804d-037d45855bb3 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:24.209726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d0f75dba-3cef-4279-804d-037d45855bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:24.257834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:24.357124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75dba-3cef-4279-804d-037d45855bb3 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:24.477273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27d15e-636d-4d30-a17d-3fe4a0c51116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:24.477803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27d15e-636d-4d30-a17d-3fe4a0c51116 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:24.478080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27d15e-636d-4d30-a17d-3fe4a0c51116 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:24.478430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27d15e-636d-4d30-a17d-3fe4a0c51116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:24.480000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ff27d15e-636d-4d30-a17d-3fe4a0c51116 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:24.487926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:24.572052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27d15e-636d-4d30-a17d-3fe4a0c51116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:24.573614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27d15e-636d-4d30-a17d-3fe4a0c51116 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:24.592757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 725/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:25.733962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0bc6-c5b1-4f32-968e-19d9da985937 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:25.734534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0bc6-c5b1-4f32-968e-19d9da985937 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:25.734534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0bc6-c5b1-4f32-968e-19d9da985937 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:25.735900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 12:11:25.742703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995ccbb-b30a-4b46-9161-b941bc627162 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:25.743216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995ccbb-b30a-4b46-9161-b941bc627162 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:25.743325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995ccbb-b30a-4b46-9161-b941bc627162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:25.817636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9995ccbb-b30a-4b46-9161-b941bc627162 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:25.818864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9995ccbb-b30a-4b46-9161-b941bc627162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:25.885780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:25.914307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:11:26.065583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0bc6-c5b1-4f32-968e-19d9da985937 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:26.067161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-828e0bc6-c5b1-4f32-968e-19d9da985937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:26.085349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:26.214110 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0bc6-c5b1-4f32-968e-19d9da985937 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:26.300676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:26.330698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988300fe-93d2-447b-8419-b2a17e398353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:26.331308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988300fe-93d2-447b-8419-b2a17e398353 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:26.331588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988300fe-93d2-447b-8419-b2a17e398353 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:26.331899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988300fe-93d2-447b-8419-b2a17e398353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:26.333491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-988300fe-93d2-447b-8419-b2a17e398353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:26.423823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988300fe-93d2-447b-8419-b2a17e398353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:26.425429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988300fe-93d2-447b-8419-b2a17e398353 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:26.444300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 708/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:27.588940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5b308-d345-42e8-812f-ec47a19732ec None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:27.589504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5b308-d345-42e8-812f-ec47a19732ec None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:27.589504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5b308-d345-42e8-812f-ec47a19732ec None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:27.590878 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:27.597311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad77c3-95cb-42bb-9267-f571ba374133 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:27.597732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad77c3-95cb-42bb-9267-f571ba374133 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:27.597845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad77c3-95cb-42bb-9267-f571ba374133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:27.673310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-90ad77c3-95cb-42bb-9267-f571ba374133 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:27.674532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-90ad77c3-95cb-42bb-9267-f571ba374133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:27.724116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:27.779680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:27.929143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5b308-d345-42e8-812f-ec47a19732ec None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:27.930744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2fd5b308-d345-42e8-812f-ec47a19732ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:28.075339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5b308-d345-42e8-812f-ec47a19732ec None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:28.139463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:28.198566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165a154-b189-47bf-b92b-d40f4c9448f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:28.199169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a154-b189-47bf-b92b-d40f4c9448f6 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:28.199452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a154-b189-47bf-b92b-d40f4c9448f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:28.199801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a154-b189-47bf-b92b-d40f4c9448f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:28.201372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4165a154-b189-47bf-b92b-d40f4c9448f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:28.292681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a154-b189-47bf-b92b-d40f4c9448f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:28.294311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a154-b189-47bf-b92b-d40f4c9448f6 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:28.313581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 728/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:29.450865 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0061b2-63e4-4c49-9c22-6d89176e3169 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:29.451466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0061b2-63e4-4c49-9c22-6d89176e3169 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:29.451466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0061b2-63e4-4c49-9c22-6d89176e3169 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:29.452739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:29.459287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559a5c-c621-495f-9da9-a2fd0690da09 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:29.459801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559a5c-c621-495f-9da9-a2fd0690da09 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:29.459898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559a5c-c621-495f-9da9-a2fd0690da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:29.534754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5c559a5c-c621-495f-9da9-a2fd0690da09 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:29.536004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5c559a5c-c621-495f-9da9-a2fd0690da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:29.538023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:29.632565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:29.787151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0061b2-63e4-4c49-9c22-6d89176e3169 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:29.788590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-fa0061b2-63e4-4c49-9c22-6d89176e3169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:29.932033 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0061b2-63e4-4c49-9c22-6d89176e3169 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:29.959052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:30.045526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107367-80cf-4641-8af3-bca3c0638cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:30.046084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107367-80cf-4641-8af3-bca3c0638cce service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:30.046368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107367-80cf-4641-8af3-bca3c0638cce service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:30.046643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107367-80cf-4641-8af3-bca3c0638cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:30.048364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-00107367-80cf-4641-8af3-bca3c0638cce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:30.137645 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107367-80cf-4641-8af3-bca3c0638cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:30.139748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107367-80cf-4641-8af3-bca3c0638cce service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:30.158094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 711/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:32.254228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421779-2b16-4ffe-932b-5cf5507ffe5b None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:32.254799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421779-2b16-4ffe-932b-5cf5507ffe5b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:32.254799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421779-2b16-4ffe-932b-5cf5507ffe5b None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:32.256110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:32.261565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbf3a9-2e2d-4906-bb8c-8b73c9d18b52 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:32.262027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbf3a9-2e2d-4906-bb8c-8b73c9d18b52 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:32.262131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbf3a9-2e2d-4906-bb8c-8b73c9d18b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:32.302528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:32.327896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f7bbf3a9-2e2d-4906-bb8c-8b73c9d18b52 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:32.329098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f7bbf3a9-2e2d-4906-bb8c-8b73c9d18b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:32.432548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:32.734451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421779-2b16-4ffe-932b-5cf5507ffe5b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:32.736026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0f421779-2b16-4ffe-932b-5cf5507ffe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:32.836384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421779-2b16-4ffe-932b-5cf5507ffe5b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:32.867718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:32.908138 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3eaa7d-72b0-4fa3-8123-60a7cb7ebacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:32.908738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eaa7d-72b0-4fa3-8123-60a7cb7ebacd service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:32.909013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eaa7d-72b0-4fa3-8123-60a7cb7ebacd service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:32.909280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eaa7d-72b0-4fa3-8123-60a7cb7ebacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:32.910855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0a3eaa7d-72b0-4fa3-8123-60a7cb7ebacd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:33.020960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3eaa7d-72b0-4fa3-8123-60a7cb7ebacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:33.022308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3eaa7d-72b0-4fa3-8123-60a7cb7ebacd service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:33.040234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 731/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:35.373966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939430-47ad-4d67-8421-28519ebdf2b3 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:35.374519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939430-47ad-4d67-8421-28519ebdf2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:35.374519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939430-47ad-4d67-8421-28519ebdf2b3 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:35.376282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:35.382305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ce82-f4ac-4360-bad9-bd87215c8616 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:35.382874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ce82-f4ac-4360-bad9-bd87215c8616 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:35.382874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ce82-f4ac-4360-bad9-bd87215c8616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:35.463216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ee50ce82-f4ac-4360-bad9-bd87215c8616 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:35.464473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ee50ce82-f4ac-4360-bad9-bd87215c8616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:35.477688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:35.562773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:35.848247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c939430-47ad-4d67-8421-28519ebdf2b3 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:35.850044 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-1c939430-47ad-4d67-8421-28519ebdf2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:35.954443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c939430-47ad-4d67-8421-28519ebdf2b3 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:35.966237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:36.033581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef9811-399d-44a0-b1df-d5a5312ff553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:36.034280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9811-399d-44a0-b1df-d5a5312ff553 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:36.034756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9811-399d-44a0-b1df-d5a5312ff553 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:36.035036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9811-399d-44a0-b1df-d5a5312ff553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:36.036741 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a2ef9811-399d-44a0-b1df-d5a5312ff553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:36.152318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef9811-399d-44a0-b1df-d5a5312ff553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:36.153754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef9811-399d-44a0-b1df-d5a5312ff553 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:36.173003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 714/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:38.733889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033eab-6c93-4f53-a68c-86231ca06d3d None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:38.734490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033eab-6c93-4f53-a68c-86231ca06d3d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:38.734490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033eab-6c93-4f53-a68c-86231ca06d3d None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:38.735812 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:38.741263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bcc42-5c31-46f8-b7bf-0dfa699c99d7 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:38.741700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bcc42-5c31-46f8-b7bf-0dfa699c99d7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:38.741848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bcc42-5c31-46f8-b7bf-0dfa699c99d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:38.790021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:38.807599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-2e4bcc42-5c31-46f8-b7bf-0dfa699c99d7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:38.808833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2e4bcc42-5c31-46f8-b7bf-0dfa699c99d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:38.905202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:39.191415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a033eab-6c93-4f53-a68c-86231ca06d3d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:39.192970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2a033eab-6c93-4f53-a68c-86231ca06d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:39.296249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a033eab-6c93-4f53-a68c-86231ca06d3d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:39.336752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:39.371052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64dd2-c0a3-4a96-9ae5-fdc0ef1538a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:39.371585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64dd2-c0a3-4a96-9ae5-fdc0ef1538a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:39.371894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64dd2-c0a3-4a96-9ae5-fdc0ef1538a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:39.372167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64dd2-c0a3-4a96-9ae5-fdc0ef1538a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:39.373805 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b6c64dd2-c0a3-4a96-9ae5-fdc0ef1538a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:39.485186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c64dd2-c0a3-4a96-9ae5-fdc0ef1538a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:39.486631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c64dd2-c0a3-4a96-9ae5-fdc0ef1538a5 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:39.505007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 734/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:41.823036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fc437-842c-4771-9a6f-1f1cbc23abd4 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:41.823608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fc437-842c-4771-9a6f-1f1cbc23abd4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:41.823608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fc437-842c-4771-9a6f-1f1cbc23abd4 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:41.825019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:41.830797 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91cde-3d2c-47fb-8025-c0d654eecc55 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:41.831250 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91cde-3d2c-47fb-8025-c0d654eecc55 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:41.831373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91cde-3d2c-47fb-8025-c0d654eecc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:41.897394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-19e91cde-3d2c-47fb-8025-c0d654eecc55 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:41.898604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-19e91cde-3d2c-47fb-8025-c0d654eecc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:41.919220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:41.993479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:42.294598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fc437-842c-4771-9a6f-1f1cbc23abd4 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:42.296186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-db0fc437-842c-4771-9a6f-1f1cbc23abd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:42.404573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fc437-842c-4771-9a6f-1f1cbc23abd4 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:42.427485 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:42.482682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c33691-01c8-4c85-b836-c1116245f500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:42.483287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c33691-01c8-4c85-b836-c1116245f500 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:42.483564 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c33691-01c8-4c85-b836-c1116245f500 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:42.483863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c33691-01c8-4c85-b836-c1116245f500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:42.485447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c7c33691-01c8-4c85-b836-c1116245f500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:42.597008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c33691-01c8-4c85-b836-c1116245f500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:42.598878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c33691-01c8-4c85-b836-c1116245f500 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:42.618158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 717/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:44.843246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff680-6abc-40f0-92bf-6f0b5d2131cc None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:44.843827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff680-6abc-40f0-92bf-6f0b5d2131cc None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:44.843827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff680-6abc-40f0-92bf-6f0b5d2131cc None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:44.845158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:44.850646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6db10-f5bb-4026-a175-e98e5cb43ccf None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:44.851041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6db10-f5bb-4026-a175-e98e5cb43ccf None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:44.851200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6db10-f5bb-4026-a175-e98e5cb43ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:44.913813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:44.916427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-abb6db10-f5bb-4026-a175-e98e5cb43ccf None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:44.917644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-abb6db10-f5bb-4026-a175-e98e5cb43ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:45.013280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:45.299564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbff680-6abc-40f0-92bf-6f0b5d2131cc None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:45.301124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8dbff680-6abc-40f0-92bf-6f0b5d2131cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:45.404001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbff680-6abc-40f0-92bf-6f0b5d2131cc None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:45.453659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:45.477949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a403df0-1954-423e-ae68-3651a9e50ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:45.478561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a403df0-1954-423e-ae68-3651a9e50ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:45.478920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a403df0-1954-423e-ae68-3651a9e50ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:45.479202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a403df0-1954-423e-ae68-3651a9e50ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:45.480835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6a403df0-1954-423e-ae68-3651a9e50ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:45.592877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a403df0-1954-423e-ae68-3651a9e50ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:45.594400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a403df0-1954-423e-ae68-3651a9e50ca3 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:45.614286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 737/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:47.892115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7492c0-32bc-4d60-9f9c-ce8cfdbb2f3f None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:47.892719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7492c0-32bc-4d60-9f9c-ce8cfdbb2f3f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:47.892719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7492c0-32bc-4d60-9f9c-ce8cfdbb2f3f None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:47.894028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:47.899614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857c0df-3431-4572-83d9-ec98fe5c5219 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:47.900074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857c0df-3431-4572-83d9-ec98fe5c5219 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:47.900196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857c0df-3431-4572-83d9-ec98fe5c5219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:47.964333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6857c0df-3431-4572-83d9-ec98fe5c5219 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:47.965521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6857c0df-3431-4572-83d9-ec98fe5c5219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:47.994048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:48.064213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:11:48.350805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7492c0-32bc-4d60-9f9c-ce8cfdbb2f3f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:48.352481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6a7492c0-32bc-4d60-9f9c-ce8cfdbb2f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:48.461356 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7492c0-32bc-4d60-9f9c-ce8cfdbb2f3f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:48.498518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:48.546283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea198ea-883f-4c89-b570-313059a317ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:48.546894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea198ea-883f-4c89-b570-313059a317ba service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:48.547177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea198ea-883f-4c89-b570-313059a317ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:48.547452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea198ea-883f-4c89-b570-313059a317ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:48.549199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-1ea198ea-883f-4c89-b570-313059a317ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:48.663942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea198ea-883f-4c89-b570-313059a317ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:48.665370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea198ea-883f-4c89-b570-313059a317ba service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:48.683529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 720/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:50.964894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a151c28-cd7f-4691-b9d2-7272d4894995 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:50.965464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a151c28-cd7f-4691-b9d2-7272d4894995 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:50.965464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a151c28-cd7f-4691-b9d2-7272d4894995 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:50.967491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:50.972757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02df74-144f-4526-b7c9-f9e74bfec38b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:50.973424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02df74-144f-4526-b7c9-f9e74bfec38b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:50.973562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02df74-144f-4526-b7c9-f9e74bfec38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:51.038409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-de02df74-144f-4526-b7c9-f9e74bfec38b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:51.039607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-de02df74-144f-4526-b7c9-f9e74bfec38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:51.047893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:51.144883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:51.430050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a151c28-cd7f-4691-b9d2-7272d4894995 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:51.431643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5a151c28-cd7f-4691-b9d2-7272d4894995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:51.536444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a151c28-cd7f-4691-b9d2-7272d4894995 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:51.592640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:51.610799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d191d-accb-442d-b8f0-0fd9818c3bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:51.611408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d191d-accb-442d-b8f0-0fd9818c3bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:51.611747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d191d-accb-442d-b8f0-0fd9818c3bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:51.612024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d191d-accb-442d-b8f0-0fd9818c3bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:51.613623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-677d191d-accb-442d-b8f0-0fd9818c3bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:51.722657 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d191d-accb-442d-b8f0-0fd9818c3bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:51.724275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d191d-accb-442d-b8f0-0fd9818c3bb3 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:51.742691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 740/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:53.958188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653ba64-f09c-4bfc-a29e-903f72fbdadb None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:53.958761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653ba64-f09c-4bfc-a29e-903f72fbdadb None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:53.958761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653ba64-f09c-4bfc-a29e-903f72fbdadb None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:53.960185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:53.965757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba9268-2961-4f65-b33b-cac39c3f6a18 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:53.966768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba9268-2961-4f65-b33b-cac39c3f6a18 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:53.966904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba9268-2961-4f65-b33b-cac39c3f6a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:54.036095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6aba9268-2961-4f65-b33b-cac39c3f6a18 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:54.037320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6aba9268-2961-4f65-b33b-cac39c3f6a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:54.077242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:54.136625 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:54.425492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653ba64-f09c-4bfc-a29e-903f72fbdadb None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:54.427134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f653ba64-f09c-4bfc-a29e-903f72fbdadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:54.537886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653ba64-f09c-4bfc-a29e-903f72fbdadb None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:54.577518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:54.614086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713312f-9c2d-4719-b6bc-6adaadc2746f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:54.614685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713312f-9c2d-4719-b6bc-6adaadc2746f service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:54.614961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713312f-9c2d-4719-b6bc-6adaadc2746f service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:54.615236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713312f-9c2d-4719-b6bc-6adaadc2746f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:54.616849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e713312f-9c2d-4719-b6bc-6adaadc2746f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:54.727554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713312f-9c2d-4719-b6bc-6adaadc2746f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:54.728917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713312f-9c2d-4719-b6bc-6adaadc2746f service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:54.746855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 723/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:56.988338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e50c4d-952c-4cc6-817e-1f6aa4058201 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:56.988916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e50c4d-952c-4cc6-817e-1f6aa4058201 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:56.988916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e50c4d-952c-4cc6-817e-1f6aa4058201 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:56.990267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:56.995798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dad35-dbd1-42a5-abbf-03d4b86c74b6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:56.996214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dad35-dbd1-42a5-abbf-03d4b86c74b6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:56.996352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dad35-dbd1-42a5-abbf-03d4b86c74b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:57.062860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6e4dad35-dbd1-42a5-abbf-03d4b86c74b6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:11:57.064094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6e4dad35-dbd1-42a5-abbf-03d4b86c74b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:57.082785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:57.165268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:11:57.448875 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e50c4d-952c-4cc6-817e-1f6aa4058201 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:11:57.451116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-49e50c4d-952c-4cc6-817e-1f6aa4058201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:57.552144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e50c4d-952c-4cc6-817e-1f6aa4058201 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:11:57.618807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:57.625871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e166a-7837-421e-b409-46fe07f649f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:11:57.626480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e166a-7837-421e-b409-46fe07f649f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:57.626764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e166a-7837-421e-b409-46fe07f649f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:57.627043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e166a-7837-421e-b409-46fe07f649f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:57.628674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-461e166a-7837-421e-b409-46fe07f649f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:11:57.737424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e166a-7837-421e-b409-46fe07f649f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:11:57.738766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e166a-7837-421e-b409-46fe07f649f8 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:11:57.758860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 743/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:11:59.971231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba314-55a1-47c1-9b4c-a20730f37b43 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:59.971975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba314-55a1-47c1-9b4c-a20730f37b43 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:59.971975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba314-55a1-47c1-9b4c-a20730f37b43 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:11:59.973423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:11:59.978674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6acc1-aba7-4307-8077-3ff09c9c628a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:11:59.979137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6acc1-aba7-4307-8077-3ff09c9c628a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:11:59.979227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6acc1-aba7-4307-8077-3ff09c9c628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:00.044792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2ef6acc1-aba7-4307-8077-3ff09c9c628a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:12:00.046008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2ef6acc1-aba7-4307-8077-3ff09c9c628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:00.093338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:00.145611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:12:00.434098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ba314-55a1-47c1-9b4c-a20730f37b43 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:12:00.436237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-394ba314-55a1-47c1-9b4c-a20730f37b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:00.544682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ba314-55a1-47c1-9b4c-a20730f37b43 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:12:00.592961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:00.618831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3e637-03e7-462b-a962-d39fcfe9de42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:12:00.619464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3e637-03e7-462b-a962-d39fcfe9de42 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:00.619783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3e637-03e7-462b-a962-d39fcfe9de42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:00.620056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3e637-03e7-462b-a962-d39fcfe9de42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:00.621680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-73d3e637-03e7-462b-a962-d39fcfe9de42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:00.734688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3e637-03e7-462b-a962-d39fcfe9de42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:12:00.736137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3e637-03e7-462b-a962-d39fcfe9de42 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:12:00.756653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 726/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:12:10.144277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=22 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:10.754289 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=66 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:21.101820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f464-1f20-455d-b521-d71a381fcf8a None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:21.102677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f464-1f20-455d-b521-d71a381fcf8a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:21.102870 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f464-1f20-455d-b521-d71a381fcf8a None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:21.104313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 745/1471] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:12:21.109690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4388-a087-49b2-97bf-fd49ef977536 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:21.110137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4388-a087-49b2-97bf-fd49ef977536 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:21.110268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4388-a087-49b2-97bf-fd49ef977536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:21.176685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-18dc4388-a087-49b2-97bf-fd49ef977536 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:12:21.177926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-18dc4388-a087-49b2-97bf-fd49ef977536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:21.277082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 727/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:12:21.576788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4df9c-e76c-4d10-82e9-210d5e6036f7 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:21.577079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4df9c-e76c-4d10-82e9-210d5e6036f7 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:21.577356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4df9c-e76c-4d10-82e9-210d5e6036f7 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:21.578731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 746/1473] 10.222.0.27 () {54 vars in 966 bytes} [Fri Sep 9 12:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:12:21.584062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021e67-1f74-45e7-9d1a-b64e249c2942 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:21.584348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021e67-1f74-45e7-9d1a-b64e249c2942 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:21.584618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021e67-1f74-45e7-9d1a-b64e249c2942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:21.660114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-52021e67-1f74-45e7-9d1a-b64e249c2942 None None] MFA Rules not processed for user `decb5421872c4034bbbaa8c3cd9dcb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:12:21.661311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-52021e67-1f74-45e7-9d1a-b64e249c2942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:21.681694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:21.737026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 728/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Fri Sep 9 12:12:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:12:21.744761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4df9c-e76c-4d10-82e9-210d5e6036f7 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:12:21.746896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-98c4df9c-e76c-4d10-82e9-210d5e6036f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:21.846342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4df9c-e76c-4d10-82e9-210d5e6036f7 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:12:21.918115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212780-3efc-4604-8ec9-72e4df401128 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'decb5421872c4034bbbaa8c3cd9dcb5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:12:21.918717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212780-3efc-4604-8ec9-72e4df401128 service glance] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:21.918998 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212780-3efc-4604-8ec9-72e4df401128 service glance] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:21.919271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212780-3efc-4604-8ec9-72e4df401128 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:21.920883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-85212780-3efc-4604-8ec9-72e4df401128 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:21.974242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:22.028714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85212780-3efc-4604-8ec9-72e4df401128 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:12:22.030127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85212780-3efc-4604-8ec9-72e4df401128 service glance] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:12:22.050198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 747/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:12:24.307776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0d110-0642-4049-b388-de9c148f6902 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:24.308302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0d110-0642-4049-b388-de9c148f6902 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:24.308302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0d110-0642-4049-b388-de9c148f6902 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:24.309587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 729/1476] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:12:24.314878 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81d20-bb40-444e-998a-72eb1b9b2e3b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:24.315338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81d20-bb40-444e-998a-72eb1b9b2e3b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:24.315446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81d20-bb40-444e-998a-72eb1b9b2e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:24.380530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-30e81d20-bb40-444e-998a-72eb1b9b2e3b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:12:24.381747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-30e81d20-bb40-444e-998a-72eb1b9b2e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:24.489257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 748/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:12:24.777832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0d110-0642-4049-b388-de9c148f6902 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:12:24.779346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-80f0d110-0642-4049-b388-de9c148f6902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:25.027339 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0d110-0642-4049-b388-de9c148f6902 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:12:25.085029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:25.131700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b8069-2ced-4d9c-9a9d-bd53c49a44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:12:25.132353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b8069-2ced-4d9c-9a9d-bd53c49a44c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:25.132601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b8069-2ced-4d9c-9a9d-bd53c49a44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:25.132880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b8069-2ced-4d9c-9a9d-bd53c49a44c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:25.133520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b8069-2ced-4d9c-9a9d-bd53c49a44c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:12:25.135332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WARNING py.warnings [None req-5d5b8069-2ced-4d9c-9a9d-bd53c49a44c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:12:25.135332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: warnings.warn(msg) Sep 09 12:12:25.135332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: Sep 09 12:12:25.137070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b8069-2ced-4d9c-9a9d-bd53c49a44c2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:12:25.156719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 730/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 12:12:24 2022] GET /identity/v3/projects => generated 2553 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:12:27.369408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df794c-96b1-4433-99b7-a27669fd7d0c None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:27.370466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df794c-96b1-4433-99b7-a27669fd7d0c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:27.370466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df794c-96b1-4433-99b7-a27669fd7d0c None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:27.371773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 749/1479] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:12:27.377103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1697bd6-a46c-493d-a788-b11aa269ee50 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:27.377557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1697bd6-a46c-493d-a788-b11aa269ee50 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:27.377663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1697bd6-a46c-493d-a788-b11aa269ee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:27.443645 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-c1697bd6-a46c-493d-a788-b11aa269ee50 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:12:27.444888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c1697bd6-a46c-493d-a788-b11aa269ee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:27.539170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 731/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:12:27.831875 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df794c-96b1-4433-99b7-a27669fd7d0c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:12:27.833440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d4df794c-96b1-4433-99b7-a27669fd7d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:27.843064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:27.979050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df794c-96b1-4433-99b7-a27669fd7d0c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:12:28.059545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:28.092611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb6f02-b9de-4612-b2ea-d29c0ede8d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:12:28.093133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb6f02-b9de-4612-b2ea-d29c0ede8d95 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:28.093411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb6f02-b9de-4612-b2ea-d29c0ede8d95 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:28.093709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb6f02-b9de-4612-b2ea-d29c0ede8d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:28.095549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-32fb6f02-b9de-4612-b2ea-d29c0ede8d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:28.192435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb6f02-b9de-4612-b2ea-d29c0ede8d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:12:28.194040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb6f02-b9de-4612-b2ea-d29c0ede8d95 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:12:28.212312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 750/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:12:30.585839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c564e-35be-4c8a-b5ec-a4779e4398cf None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:30.586385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c564e-35be-4c8a-b5ec-a4779e4398cf None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:30.586385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c564e-35be-4c8a-b5ec-a4779e4398cf None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:30.587750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 732/1482] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:12:30.593138 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b66663-94e0-464d-a4db-3250ae0a1b09 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:30.593726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b66663-94e0-464d-a4db-3250ae0a1b09 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:30.593726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b66663-94e0-464d-a4db-3250ae0a1b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:30.664216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-79b66663-94e0-464d-a4db-3250ae0a1b09 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:12:30.665488 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-79b66663-94e0-464d-a4db-3250ae0a1b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:30.713838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:30.764451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 751/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:12:31.053650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c564e-35be-4c8a-b5ec-a4779e4398cf None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:12:31.055254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2f5c564e-35be-4c8a-b5ec-a4779e4398cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:31.081886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:31.163633 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c564e-35be-4c8a-b5ec-a4779e4398cf None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:12:31.238855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202eb6-d42c-4c64-adc6-2453e4aa7820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:12:31.239462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202eb6-d42c-4c64-adc6-2453e4aa7820 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:31.239773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202eb6-d42c-4c64-adc6-2453e4aa7820 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:31.240047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202eb6-d42c-4c64-adc6-2453e4aa7820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:31.242842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-67202eb6-d42c-4c64-adc6-2453e4aa7820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:31.314194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:31.349562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67202eb6-d42c-4c64-adc6-2453e4aa7820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:12:31.351048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67202eb6-d42c-4c64-adc6-2453e4aa7820 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:12:31.369198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 733/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:12:33.582275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbed542-5b01-4fd1-8681-86d570034620 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:33.582872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbed542-5b01-4fd1-8681-86d570034620 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:33.582872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbed542-5b01-4fd1-8681-86d570034620 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:33.584220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 752/1485] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:12:33.589372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953820c3-b417-4a81-9bc1-e84e43557c92 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:33.590126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953820c3-b417-4a81-9bc1-e84e43557c92 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:33.590126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953820c3-b417-4a81-9bc1-e84e43557c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:33.655859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-953820c3-b417-4a81-9bc1-e84e43557c92 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:12:33.657071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-953820c3-b417-4a81-9bc1-e84e43557c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:33.752763 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 734/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:12:34.054612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbed542-5b01-4fd1-8681-86d570034620 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:12:34.056173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-efbed542-5b01-4fd1-8681-86d570034620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:34.163758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbed542-5b01-4fd1-8681-86d570034620 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:12:34.234564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:34.236086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6008c-b972-4253-b080-e502502ec94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:12:34.236694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6008c-b972-4253-b080-e502502ec94f service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:34.236978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6008c-b972-4253-b080-e502502ec94f service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:34.237251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6008c-b972-4253-b080-e502502ec94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:34.238852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6ac6008c-b972-4253-b080-e502502ec94f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:34.347124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6008c-b972-4253-b080-e502502ec94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:12:34.348591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6008c-b972-4253-b080-e502502ec94f service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:12:34.366618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 753/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:12:36.696486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda2394-456e-473a-8a6b-e985c5ad081d None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:36.697577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda2394-456e-473a-8a6b-e985c5ad081d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:36.697577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda2394-456e-473a-8a6b-e985c5ad081d None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:36.698899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 735/1488] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:12:36.704255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95119ff4-eff4-489e-875f-cedaf3325b1a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:36.704705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95119ff4-eff4-489e-875f-cedaf3325b1a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:36.704842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95119ff4-eff4-489e-875f-cedaf3325b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:36.777618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-95119ff4-eff4-489e-875f-cedaf3325b1a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:12:36.778828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-95119ff4-eff4-489e-875f-cedaf3325b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:36.829488 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:36.874187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 754/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:12:37.168202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda2394-456e-473a-8a6b-e985c5ad081d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:12:37.169722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bbda2394-456e-473a-8a6b-e985c5ad081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:37.205133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:37.273512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda2394-456e-473a-8a6b-e985c5ad081d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:12:37.348104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb96e0-3077-40e3-8f9c-053060719d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:12:37.348707 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb96e0-3077-40e3-8f9c-053060719d3f service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:37.348991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb96e0-3077-40e3-8f9c-053060719d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:37.349264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb96e0-3077-40e3-8f9c-053060719d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:37.350847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d9cb96e0-3077-40e3-8f9c-053060719d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:37.430630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:37.459635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb96e0-3077-40e3-8f9c-053060719d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:12:37.461085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb96e0-3077-40e3-8f9c-053060719d3f service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:12:37.480123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 736/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:12:40.023914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f219b-0b38-4e16-8f41-51e82e981cd0 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:40.024486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f219b-0b38-4e16-8f41-51e82e981cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:40.024486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f219b-0b38-4e16-8f41-51e82e981cd0 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:40.025816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 755/1491] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 12:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:12:40.031147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07046bc4-f8bb-42c9-ad50-c0b463e96125 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:40.031682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07046bc4-f8bb-42c9-ad50-c0b463e96125 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:40.043871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07046bc4-f8bb-42c9-ad50-c0b463e96125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:40.102832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-07046bc4-f8bb-42c9-ad50-c0b463e96125 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:12:40.104109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-07046bc4-f8bb-42c9-ad50-c0b463e96125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:40.200988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 737/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 12:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:12:40.496129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f219b-0b38-4e16-8f41-51e82e981cd0 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:12:40.497664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9c9f219b-0b38-4e16-8f41-51e82e981cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:40.598988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f219b-0b38-4e16-8f41-51e82e981cd0 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:12:40.673016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f52618-6d14-47a2-b0fc-e7c552b0b330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:12:40.679584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52618-6d14-47a2-b0fc-e7c552b0b330 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:12:40.680347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52618-6d14-47a2-b0fc-e7c552b0b330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:12:40.680635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f52618-6d14-47a2-b0fc-e7c552b0b330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:12:40.682316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-08f52618-6d14-47a2-b0fc-e7c552b0b330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:12:40.691339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:40.798443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f52618-6d14-47a2-b0fc-e7c552b0b330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:12:40.799881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f52618-6d14-47a2-b0fc-e7c552b0b330 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:12:40.817307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 756/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:12:50.197704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=82 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:50.815117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=50 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:02.694235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34dbb-f0ee-4f7e-82d0-db374b815236 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:02.694874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34dbb-f0ee-4f7e-82d0-db374b815236 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:02.694874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34dbb-f0ee-4f7e-82d0-db374b815236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:02.772486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b7c34dbb-f0ee-4f7e-82d0-db374b815236 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:14:02.773737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b7c34dbb-f0ee-4f7e-82d0-db374b815236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:02.873272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 738/1494] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:14:02.881872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a0705-a535-4b4a-b5b5-6a2ffd19ea50 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:02.882375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a0705-a535-4b4a-b5b5-6a2ffd19ea50 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:02.882483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a0705-a535-4b4a-b5b5-6a2ffd19ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:02.960311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ab6a0705-a535-4b4a-b5b5-6a2ffd19ea50 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:14:02.961463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ab6a0705-a535-4b4a-b5b5-6a2ffd19ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:03.061334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 757/1495] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:14:03.066049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34dbb-f0ee-4f7e-82d0-db374b815236 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:03.067288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b7c34dbb-f0ee-4f7e-82d0-db374b815236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:03.078989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34dbb-f0ee-4f7e-82d0-db374b815236 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:03.146221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:03.186745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:03.187422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:03.187782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:03.188101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:03.188869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:14:03.189250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:03.190322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WARNING py.warnings [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:14:03.190322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: warnings.warn(msg) Sep 09 12:14:03.190322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: Sep 09 12:14:03.191354 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:03.203810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 739/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:14:03.212052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a0705-a535-4b4a-b5b5-6a2ffd19ea50 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:03.221393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a0705-a535-4b4a-b5b5-6a2ffd19ea50 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:03.284134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:03.319174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:03.319814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:03.320099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:03.320376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:03.321029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:03.322806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WARNING py.warnings [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:14:03.322806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: warnings.warn(msg) Sep 09 12:14:03.322806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: Sep 09 12:14:03.324025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:03.439353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 758/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:14:03 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:14:03.444465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:03.446961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:03.479918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653070c9-7cfa-4e3a-91af-bd14f04f9169 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:03.572990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:03.573604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:03.573887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:03.574161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:03.574783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:03.575819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WARNING py.warnings [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:14:03.575819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: warnings.warn(msg) Sep 09 12:14:03.575819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: Sep 09 12:14:03.577016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:03.672772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 740/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:14:03 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:14:03.677573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:03.679103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:03.741002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835b9d5-8a1c-4901-91f8-22b17816d731 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:03.824602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:03.835210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:03.838522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:03.838522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:03.838522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:03.838522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:03.838522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WARNING py.warnings [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:14:03.838522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: warnings.warn(msg) Sep 09 12:14:03.838522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: Sep 09 12:14:03.839410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:03.852490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 759/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:14:03.856630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:03.858137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:03.870084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af85a4c-d276-4dca-955b-7966ddd2bce1 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:03.894718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:03.964253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0456f-ac79-4950-bb81-b714e942c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:03.964870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0456f-ac79-4950-bb81-b714e942c519 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:03.965155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0456f-ac79-4950-bb81-b714e942c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:03.965430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0456f-ac79-4950-bb81-b714e942c519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:03.966072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0456f-ac79-4950-bb81-b714e942c519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:03.967089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WARNING py.warnings [None req-c8d0456f-ac79-4950-bb81-b714e942c519 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:14:03.967089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: warnings.warn(msg) Sep 09 12:14:03.967089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: Sep 09 12:14:03.968019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0456f-ac79-4950-bb81-b714e942c519 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:03.980861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 741/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:14:03.985151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:03.986690 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:04.019745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f38078-d7d9-4d7b-a2a4-c94ea633638a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:04.115398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534e060-1217-48bb-89bf-bb14138add61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:04.116140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e060-1217-48bb-89bf-bb14138add61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:04.116384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e060-1217-48bb-89bf-bb14138add61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:04.116651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e060-1217-48bb-89bf-bb14138add61 admin admin] PATH_INFO: `/v3/projects/f239c0f2edeb4d3ab34244aca55f1624/users/daff292bad6948a3bcd0c2c6ac9ec6c5/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:04.138980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534e060-1217-48bb-89bf-bb14138add61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f239c0f2edeb4d3ab34244aca55f1624, user_id=daff292bad6948a3bcd0c2c6ac9ec6c5, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:04.140036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WARNING py.warnings [None req-b534e060-1217-48bb-89bf-bb14138add61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:14:04.140036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: warnings.warn(msg) Sep 09 12:14:04.140036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: Sep 09 12:14:04.141953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534e060-1217-48bb-89bf-bb14138add61 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:04.229146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 760/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:14:03 2022] PUT /identity/v3/projects/f239c0f2edeb4d3ab34244aca55f1624/users/daff292bad6948a3bcd0c2c6ac9ec6c5/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:14:04.241628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eca89-d7be-45f6-9115-c67a1a155bb8 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:04.241913 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eca89-d7be-45f6-9115-c67a1a155bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:04.242192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eca89-d7be-45f6-9115-c67a1a155bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:04.298997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-973eca89-d7be-45f6-9115-c67a1a155bb8 None None] MFA Rules not processed for user `daff292bad6948a3bcd0c2c6ac9ec6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:14:04.300209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-973eca89-d7be-45f6-9115-c67a1a155bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:04.379183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 742/1502] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:14:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:14:04.392831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf9126-ae14-4179-b2da-95da8daeaa4c None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:04.393116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf9126-ae14-4179-b2da-95da8daeaa4c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:04.393387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf9126-ae14-4179-b2da-95da8daeaa4c None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:04.394771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 761/1503] 10.222.0.27 () {54 vars in 964 bytes} [Fri Sep 9 12:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:14:04.400069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa191-0a17-410f-8321-88f8f600630f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:04.400359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa191-0a17-410f-8321-88f8f600630f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:04.400633 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa191-0a17-410f-8321-88f8f600630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:04.432769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:04.489848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-47baa191-0a17-410f-8321-88f8f600630f None None] MFA Rules not processed for user `6ce95a25d894457d8cd45c30b38f014e`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:14:04.491070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-47baa191-0a17-410f-8321-88f8f600630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:04.570596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 743/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Sep 9 12:14:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:14:04.578348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf9126-ae14-4179-b2da-95da8daeaa4c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:04.579937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b2bf9126-ae14-4179-b2da-95da8daeaa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:04.630007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:04.683174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf9126-ae14-4179-b2da-95da8daeaa4c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:04.756444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:04.756444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:04.756444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:04.756444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:04.759156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:04.857514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:04.858853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:04.862329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:04.876820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 762/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:14:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:14:04.923554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357f60-cfd3-4635-a0f1-732a249f4ed7 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:04.924020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357f60-cfd3-4635-a0f1-732a249f4ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:04.924150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357f60-cfd3-4635-a0f1-732a249f4ed7 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:04.925391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 744/1506] 10.222.0.27 () {52 vars in 830 bytes} [Fri Sep 9 12:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:14:04.928995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:04.930188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:05.028665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dc5bd-78fc-450d-aa47-86d2c978f485 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:05.122502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:05.123139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:05.123423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:05.123729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] PATH_INFO: `/v3/users/daff292bad6948a3bcd0c2c6ac9ec6c5` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:05.137369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] RBAC: Authorizing `identity:delete_user(user_id=daff292bad6948a3bcd0c2c6ac9ec6c5)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:05.138396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WARNING py.warnings [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:14:05.138396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: warnings.warn(msg) Sep 09 12:14:05.138396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: Sep 09 12:14:05.139772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:05.152029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:05.363053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daff292bad6948a3bcd0c2c6ac9ec6c5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:05.363582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daff292bad6948a3bcd0c2c6ac9ec6c5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:05.455939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daff292bad6948a3bcd0c2c6ac9ec6c5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:05.456403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daff292bad6948a3bcd0c2c6ac9ec6c5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:05.472786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daff292bad6948a3bcd0c2c6ac9ec6c5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:05.501446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 763/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:14:04 2022] DELETE /identity/v3/users/daff292bad6948a3bcd0c2c6ac9ec6c5 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:14:05.505920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d568ec5-4f2c-4394-8a57-888f00dfe7c7 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:05.506211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d568ec5-4f2c-4394-8a57-888f00dfe7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:05.506519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d568ec5-4f2c-4394-8a57-888f00dfe7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:05.563267 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6d568ec5-4f2c-4394-8a57-888f00dfe7c7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:14:05.564522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6d568ec5-4f2c-4394-8a57-888f00dfe7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:05.641663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:05.654327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 745/1508] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:14:05.664757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:05.666211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:05.766438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8321-13bc-4e78-9f60-751ccefea22c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:05.824755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:05.848071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043351b-4c42-4999-849c-3480fa742c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:05.848681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043351b-4c42-4999-849c-3480fa742c9d service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:05.848956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043351b-4c42-4999-849c-3480fa742c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:05.849220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043351b-4c42-4999-849c-3480fa742c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:05.850788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4043351b-4c42-4999-849c-3480fa742c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:05.957481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043351b-4c42-4999-849c-3480fa742c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:05.959460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043351b-4c42-4999-849c-3480fa742c9d service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:05.977762 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 764/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:14:06.406337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d568ec5-4f2c-4394-8a57-888f00dfe7c7 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:14:06.407614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6d568ec5-4f2c-4394-8a57-888f00dfe7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:14:06.419456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d568ec5-4f2c-4394-8a57-888f00dfe7c7 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:14:06.523025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:14:06.523680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:14:06.523965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:14:06.524237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] PATH_INFO: `/v3/projects/f239c0f2edeb4d3ab34244aca55f1624` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:14:06.534177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f239c0f2edeb4d3ab34244aca55f1624)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:14:06.535206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WARNING py.warnings [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:14:06.535206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: warnings.warn(msg) Sep 09 12:14:06.535206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: Sep 09 12:14:06.536466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:14:06.635741 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f239c0f2edeb4d3ab34244aca55f1624', 'request_id': 'req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:06.649622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f239c0f2edeb4d3ab34244aca55f1624', 'request_id': 'req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:06.711501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f239c0f2edeb4d3ab34244aca55f1624', 'request_id': 'req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:06.735149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] The token cache is being invalidate because project f239c0f2edeb4d3ab34244aca55f1624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:14:06.735441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:06.736004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a1c8e6c2-e3f5-451d-ad6c-fbff369ad441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:14:06.737327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 746/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:14:06 2022] DELETE /identity/v3/projects/f239c0f2edeb4d3ab34244aca55f1624 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:14:15.975604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=62 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:16.733076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:44.449772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d6073-cc30-41fe-a6fd-8bdce1c6cf23 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:44.450428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d6073-cc30-41fe-a6fd-8bdce1c6cf23 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:44.450428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d6073-cc30-41fe-a6fd-8bdce1c6cf23 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:44.451604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:15:44.456750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651965-fc27-4fcd-a085-4887bd650005 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:44.457210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651965-fc27-4fcd-a085-4887bd650005 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:44.457388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651965-fc27-4fcd-a085-4887bd650005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:44.541888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-cf651965-fc27-4fcd-a085-4887bd650005 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:15:44.543112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cf651965-fc27-4fcd-a085-4887bd650005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:15:44.647731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:15:44.801485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d6073-cc30-41fe-a6fd-8bdce1c6cf23 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:15:44.804174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-533d6073-cc30-41fe-a6fd-8bdce1c6cf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:15:44.918911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d6073-cc30-41fe-a6fd-8bdce1c6cf23 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:15:44.924305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b76907-f3ea-4ca5-9273-ff2e6668f0d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:15:44.924905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b76907-f3ea-4ca5-9273-ff2e6668f0d9 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:44.925185 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b76907-f3ea-4ca5-9273-ff2e6668f0d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:44.925456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b76907-f3ea-4ca5-9273-ff2e6668f0d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:44.933811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b76907-f3ea-4ca5-9273-ff2e6668f0d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:15:44.935362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b76907-f3ea-4ca5-9273-ff2e6668f0d9 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:15:44.944754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 766/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:15:46.034879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d4156-a458-4917-91f5-cf42c25778aa None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:46.035449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d4156-a458-4917-91f5-cf42c25778aa None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:46.035563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d4156-a458-4917-91f5-cf42c25778aa None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:46.036889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:15:46.043813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd399-bd2e-4cb7-9534-c0c37df78085 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:46.044281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd399-bd2e-4cb7-9534-c0c37df78085 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:46.044388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd399-bd2e-4cb7-9534-c0c37df78085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:46.063410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f90cd399-bd2e-4cb7-9534-c0c37df78085 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:15:46.064702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f90cd399-bd2e-4cb7-9534-c0c37df78085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:15:46.073769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:15:46.228137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d4156-a458-4917-91f5-cf42c25778aa None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:15:46.242168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d4156-a458-4917-91f5-cf42c25778aa None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:15:46.248008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fe79b-4973-49c2-888d-d0c4c64eba3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:15:46.248612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fe79b-4973-49c2-888d-d0c4c64eba3e service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:46.248898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fe79b-4973-49c2-888d-d0c4c64eba3e service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:46.249177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fe79b-4973-49c2-888d-d0c4c64eba3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:46.257467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fe79b-4973-49c2-888d-d0c4c64eba3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:15:46.259576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fe79b-4973-49c2-888d-d0c4c64eba3e service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:15:46.268888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 749/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:15:46.434280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b974fc-9ca4-4406-a2f7-32b610f68187 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:46.434702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b974fc-9ca4-4406-a2f7-32b610f68187 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:46.434990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b974fc-9ca4-4406-a2f7-32b610f68187 None None] PATH_INFO: `/v3` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:46.436359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 768/1517] 10.222.0.18 () {54 vars in 925 bytes} [Fri Sep 9 12:15:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:15:46.462619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3374-9a68-4fab-b5df-c90e6ccbfd1e None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:46.463280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3374-9a68-4fab-b5df-c90e6ccbfd1e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:46.463280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3374-9a68-4fab-b5df-c90e6ccbfd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:46.523802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b70f3374-9a68-4fab-b5df-c90e6ccbfd1e None None] MFA Rules not processed for user `03a4b508dd7048df83f7beeacfe9c085`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:15:46.524989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b70f3374-9a68-4fab-b5df-c90e6ccbfd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:15:46.541562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:46.601546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 750/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Sep 9 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:15:50.485260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9838d-0c30-4034-b3e5-f8ea8b60eebc None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:50.485769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9838d-0c30-4034-b3e5-f8ea8b60eebc None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:50.485878 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9838d-0c30-4034-b3e5-f8ea8b60eebc None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:50.487149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 769/1519] 10.222.0.27 () {54 vars in 961 bytes} [Fri Sep 9 12:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:15:50.493225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37789bb1-7d7f-4efb-91a6-4b0837f36b33 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:50.493709 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37789bb1-7d7f-4efb-91a6-4b0837f36b33 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:50.493813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37789bb1-7d7f-4efb-91a6-4b0837f36b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:50.513525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-37789bb1-7d7f-4efb-91a6-4b0837f36b33 None None] MFA Rules not processed for user `03a4b508dd7048df83f7beeacfe9c085`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:15:50.514750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-37789bb1-7d7f-4efb-91a6-4b0837f36b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:15:50.523475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 751/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Sep 9 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:15:50.531257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9838d-0c30-4034-b3e5-f8ea8b60eebc None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:15:50.545213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9838d-0c30-4034-b3e5-f8ea8b60eebc None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:15:50.550196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e5582-47f9-4eb9-8f66-830edd8f653d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:15:50.550791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e5582-47f9-4eb9-8f66-830edd8f653d service placement] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:50.551076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e5582-47f9-4eb9-8f66-830edd8f653d service placement] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:50.551353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e5582-47f9-4eb9-8f66-830edd8f653d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:50.560284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e5582-47f9-4eb9-8f66-830edd8f653d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:15:50.561880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e5582-47f9-4eb9-8f66-830edd8f653d service placement] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:15:50.571680 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 770/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:15:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:15:57.761929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f77d-1eb4-41d1-80ee-6c8b5fe59a80 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:57.762500 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f77d-1eb4-41d1-80ee-6c8b5fe59a80 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:57.762500 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f77d-1eb4-41d1-80ee-6c8b5fe59a80 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:57.763842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:15:57.769898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2efff-a95b-468f-af0d-3020f93857e3 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:57.770315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2efff-a95b-468f-af0d-3020f93857e3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:57.770452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2efff-a95b-468f-af0d-3020f93857e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:57.789756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2bc2efff-a95b-468f-af0d-3020f93857e3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:15:57.790973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2bc2efff-a95b-468f-af0d-3020f93857e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:15:57.798574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:15:57.952965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4f77d-1eb4-41d1-80ee-6c8b5fe59a80 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:15:57.967844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4f77d-1eb4-41d1-80ee-6c8b5fe59a80 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:15:57.973364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43775e6e-a4fc-49d0-9ae8-a0cd75468eb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:15:57.973969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43775e6e-a4fc-49d0-9ae8-a0cd75468eb9 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:57.974258 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43775e6e-a4fc-49d0-9ae8-a0cd75468eb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:57.974549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43775e6e-a4fc-49d0-9ae8-a0cd75468eb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:57.983416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43775e6e-a4fc-49d0-9ae8-a0cd75468eb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:15:57.985040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43775e6e-a4fc-49d0-9ae8-a0cd75468eb9 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:15:57.994384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 753/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:15:59.076483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20a586-737d-43cc-b518-05690fa4b4e5 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:59.077032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20a586-737d-43cc-b518-05690fa4b4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:59.077226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20a586-737d-43cc-b518-05690fa4b4e5 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:59.078900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 12:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:15:59.085517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604b790-0539-4473-aa30-36ff0bd0b040 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:59.085975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604b790-0539-4473-aa30-36ff0bd0b040 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:59.086071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604b790-0539-4473-aa30-36ff0bd0b040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:59.105781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-7604b790-0539-4473-aa30-36ff0bd0b040 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:15:59.107009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7604b790-0539-4473-aa30-36ff0bd0b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:15:59.115553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:15:59.268921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20a586-737d-43cc-b518-05690fa4b4e5 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:15:59.283076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20a586-737d-43cc-b518-05690fa4b4e5 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:15:59.288979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c733112-681b-4110-9483-47652f00fd97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:15:59.289576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c733112-681b-4110-9483-47652f00fd97 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:15:59.289863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c733112-681b-4110-9483-47652f00fd97 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:15:59.290142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c733112-681b-4110-9483-47652f00fd97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:15:59.298685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c733112-681b-4110-9483-47652f00fd97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:15:59.300345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c733112-681b-4110-9483-47652f00fd97 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:15:59.311753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 773/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:16:03.465849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb970-9d4c-45a7-b444-f694b7d0de5b None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:03.466419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb970-9d4c-45a7-b444-f694b7d0de5b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:03.466419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb970-9d4c-45a7-b444-f694b7d0de5b None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:03.467668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:16:03.473220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263eb10-8a64-4af2-9a09-3daa967feb4f None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:03.474037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263eb10-8a64-4af2-9a09-3daa967feb4f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:03.474344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263eb10-8a64-4af2-9a09-3daa967feb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:03.493681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8263eb10-8a64-4af2-9a09-3daa967feb4f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:16:03.494886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8263eb10-8a64-4af2-9a09-3daa967feb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:16:03.502821 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:16:03.798267 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cb970-9d4c-45a7-b444-f694b7d0de5b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:16:03.800057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5e5cb970-9d4c-45a7-b444-f694b7d0de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:16:03.877857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cb970-9d4c-45a7-b444-f694b7d0de5b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:16:03.881452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2870c7d-b819-4c2a-bf2d-4c9b85b2f2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:16:03.882045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2870c7d-b819-4c2a-bf2d-4c9b85b2f2ec service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:03.882329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2870c7d-b819-4c2a-bf2d-4c9b85b2f2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:03.882604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2870c7d-b819-4c2a-bf2d-4c9b85b2f2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:03.892162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2870c7d-b819-4c2a-bf2d-4c9b85b2f2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:16:03.893591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2870c7d-b819-4c2a-bf2d-4c9b85b2f2ec service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:16:03.902855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 756/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:16:06.091644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a86bc6-7c90-49e7-8e09-962e13974728 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:06.092212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a86bc6-7c90-49e7-8e09-962e13974728 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:06.092212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a86bc6-7c90-49e7-8e09-962e13974728 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:06.093537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:16:06.098923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f69c21-119c-480d-b380-46b4a500e291 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:06.099370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f69c21-119c-480d-b380-46b4a500e291 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:06.099478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f69c21-119c-480d-b380-46b4a500e291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:06.121574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b1f69c21-119c-480d-b380-46b4a500e291 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:16:06.122743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b1f69c21-119c-480d-b380-46b4a500e291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:16:06.130483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:16:06.428771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a86bc6-7c90-49e7-8e09-962e13974728 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:16:06.434765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=75 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:06.440963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a86bc6-7c90-49e7-8e09-962e13974728 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:16:06.446801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d8df0-df23-49c8-99ec-ab5386261b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:16:06.447478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8df0-df23-49c8-99ec-ab5386261b40 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:06.447789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8df0-df23-49c8-99ec-ab5386261b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:06.448068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8df0-df23-49c8-99ec-ab5386261b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:06.457538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d8df0-df23-49c8-99ec-ab5386261b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:16:06.458963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d8df0-df23-49c8-99ec-ab5386261b40 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:16:06.469893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 776/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:16:10.196610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6985d4-359b-489e-a72a-4a50af29526d None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:10.197127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6985d4-359b-489e-a72a-4a50af29526d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:10.197127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6985d4-359b-489e-a72a-4a50af29526d None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:10.198467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:16:10.203688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c24e2-b3b1-426f-be91-7155989d2712 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:10.204135 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c24e2-b3b1-426f-be91-7155989d2712 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:10.204247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c24e2-b3b1-426f-be91-7155989d2712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:10.224365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-827c24e2-b3b1-426f-be91-7155989d2712 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:16:10.225555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-827c24e2-b3b1-426f-be91-7155989d2712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:16:10.234180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:16:10.539226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6985d4-359b-489e-a72a-4a50af29526d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:16:10.541011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-fb6985d4-359b-489e-a72a-4a50af29526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:16:10.605740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:10.619125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6985d4-359b-489e-a72a-4a50af29526d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:16:10.622720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98028-ab10-4523-8538-fc2a1999cdf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:16:10.623325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98028-ab10-4523-8538-fc2a1999cdf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:10.623608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98028-ab10-4523-8538-fc2a1999cdf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:10.623910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98028-ab10-4523-8538-fc2a1999cdf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:10.633232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98028-ab10-4523-8538-fc2a1999cdf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:16:10.635301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98028-ab10-4523-8538-fc2a1999cdf0 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:16:10.644645 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 759/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:16:12.771738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1496-18cd-4697-8c77-6fb2b070a054 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:12.772283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1496-18cd-4697-8c77-6fb2b070a054 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:12.772283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1496-18cd-4697-8c77-6fb2b070a054 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:12.773648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 12:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:16:12.779639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93ec9-378f-451d-8eb6-e5b4e259a018 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:12.780066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93ec9-378f-451d-8eb6-e5b4e259a018 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:12.780195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93ec9-378f-451d-8eb6-e5b4e259a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:12.800520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d1a93ec9-378f-451d-8eb6-e5b4e259a018 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:16:12.802531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d1a93ec9-378f-451d-8eb6-e5b4e259a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:16:12.810307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:16:13.116289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1496-18cd-4697-8c77-6fb2b070a054 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:16:13.118018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-785d1496-18cd-4697-8c77-6fb2b070a054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:16:13.131118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1496-18cd-4697-8c77-6fb2b070a054 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:16:13.135346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f0d0a-700b-4841-8069-8df377278e72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:16:13.137281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0d0a-700b-4841-8069-8df377278e72 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:16:13.137281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0d0a-700b-4841-8069-8df377278e72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:16:13.137281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0d0a-700b-4841-8069-8df377278e72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:16:13.145865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f0d0a-700b-4841-8069-8df377278e72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:16:13.147275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f0d0a-700b-4841-8069-8df377278e72 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:16:13.157574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 779/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:16:22.795399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=11 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:23.153030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=14 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:43.756704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1e33-cc59-4815-bf42-60a018bb61e4 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:43.757876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1e33-cc59-4815-bf42-60a018bb61e4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:43.758386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1e33-cc59-4815-bf42-60a018bb61e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:43.785821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-22bc1e33-cc59-4815-bf42-60a018bb61e4 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:43.788356 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-22bc1e33-cc59-4815-bf42-60a018bb61e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:43.802467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 761/1540] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:43.812832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaad4b-22da-485d-9ecf-d9eabe606bbe None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:43.814188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaad4b-22da-485d-9ecf-d9eabe606bbe None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:43.814188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaad4b-22da-485d-9ecf-d9eabe606bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:43.842763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-adeaad4b-22da-485d-9ecf-d9eabe606bbe None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:43.844161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-adeaad4b-22da-485d-9ecf-d9eabe606bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:43.859820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 780/1541] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:43.867607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1e33-cc59-4815-bf42-60a018bb61e4 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:43.879164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1e33-cc59-4815-bf42-60a018bb61e4 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:43.892394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feea821-5d7c-4f1e-a931-e26ff4f7bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:43.893545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feea821-5d7c-4f1e-a931-e26ff4f7bf07 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:43.894063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feea821-5d7c-4f1e-a931-e26ff4f7bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:43.894577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feea821-5d7c-4f1e-a931-e26ff4f7bf07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:43.895482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feea821-5d7c-4f1e-a931-e26ff4f7bf07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:17:43.896058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feea821-5d7c-4f1e-a931-e26ff4f7bf07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:43.897981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feea821-5d7c-4f1e-a931-e26ff4f7bf07 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:43.913217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 762/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:17:43.922099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeaad4b-22da-485d-9ecf-d9eabe606bbe None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:43.938321 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeaad4b-22da-485d-9ecf-d9eabe606bbe None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:43.947355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18c7a-01b3-4386-bc3b-bf95a88dd85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:43.948033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18c7a-01b3-4386-bc3b-bf95a88dd85e admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:43.948327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18c7a-01b3-4386-bc3b-bf95a88dd85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:43.948607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18c7a-01b3-4386-bc3b-bf95a88dd85e admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:43.949284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18c7a-01b3-4386-bc3b-bf95a88dd85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:43.951227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18c7a-01b3-4386-bc3b-bf95a88dd85e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.079719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 781/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:43 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:44.086801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f9561-1c60-4100-94b3-f80dea4be06a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.086801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f9561-1c60-4100-94b3-f80dea4be06a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.086801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f9561-1c60-4100-94b3-f80dea4be06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.087077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18c7a-01b3-4386-bc3b-bf95a88dd85e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.115884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-424f9561-1c60-4100-94b3-f80dea4be06a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.117681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-424f9561-1c60-4100-94b3-f80dea4be06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.177902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18c7a-01b3-4386-bc3b-bf95a88dd85e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.190718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657723-714e-4508-a97c-71e85b1bf250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.192968 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657723-714e-4508-a97c-71e85b1bf250 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.193515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657723-714e-4508-a97c-71e85b1bf250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.194152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657723-714e-4508-a97c-71e85b1bf250 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.195123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59657723-714e-4508-a97c-71e85b1bf250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.198049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WARNING py.warnings [None req-59657723-714e-4508-a97c-71e85b1bf250 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:17:44.198049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: warnings.warn(msg) Sep 09 12:17:44.198049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: Sep 09 12:17:44.199971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59657723-714e-4508-a97c-71e85b1bf250 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.235486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 763/1544] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:17:44.241307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90dadd-3d21-4970-ad1d-03abe8493a61 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.241595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90dadd-3d21-4970-ad1d-03abe8493a61 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.241882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90dadd-3d21-4970-ad1d-03abe8493a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.262416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-bd90dadd-3d21-4970-ad1d-03abe8493a61 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.263646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bd90dadd-3d21-4970-ad1d-03abe8493a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.274922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 764/1545] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.274922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d45791-fdbc-487d-b63c-4354f7629e85 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.274922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d45791-fdbc-487d-b63c-4354f7629e85 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.274922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d45791-fdbc-487d-b63c-4354f7629e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.292775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 782/1546] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:17:44.293889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a3f6-3313-40ec-ac7d-f182b25ca633 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.294177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a3f6-3313-40ec-ac7d-f182b25ca633 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.294419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-47d45791-fdbc-487d-b63c-4354f7629e85 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.294543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a3f6-3313-40ec-ac7d-f182b25ca633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.295729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-47d45791-fdbc-487d-b63c-4354f7629e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.303675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 765/1547] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.304875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33284e49-3b31-46b0-b11b-e8459932f1be None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.305167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33284e49-3b31-46b0-b11b-e8459932f1be None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.305463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33284e49-3b31-46b0-b11b-e8459932f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.314383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-afe7a3f6-3313-40ec-ac7d-f182b25ca633 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.315568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-afe7a3f6-3313-40ec-ac7d-f182b25ca633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.323602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 783/1548] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.324840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22244ad-1f8b-4c9e-adc6-1ea1ac03f454 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.325126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22244ad-1f8b-4c9e-adc6-1ea1ac03f454 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.325400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22244ad-1f8b-4c9e-adc6-1ea1ac03f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.333699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-33284e49-3b31-46b0-b11b-e8459932f1be None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.335363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-33284e49-3b31-46b0-b11b-e8459932f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.343280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 766/1549] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.345515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-a22244ad-1f8b-4c9e-adc6-1ea1ac03f454 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.346706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a22244ad-1f8b-4c9e-adc6-1ea1ac03f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.348970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f52ce-8f88-4786-9bc0-7a92fcb06306 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.349259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f52ce-8f88-4786-9bc0-7a92fcb06306 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.350117 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f52ce-8f88-4786-9bc0-7a92fcb06306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.356675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 784/1550] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.357974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70e86d-69f7-48a2-9871-317c0b9945d5 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.358371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70e86d-69f7-48a2-9871-317c0b9945d5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.358554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70e86d-69f7-48a2-9871-317c0b9945d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.371223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-029f52ce-8f88-4786-9bc0-7a92fcb06306 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.372460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-029f52ce-8f88-4786-9bc0-7a92fcb06306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.378278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ca70e86d-69f7-48a2-9871-317c0b9945d5 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.379447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ca70e86d-69f7-48a2-9871-317c0b9945d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.380205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 767/1551] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.381554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbb596-d9bc-4ffb-bd76-55c53de6d337 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.381838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbb596-d9bc-4ffb-bd76-55c53de6d337 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.382111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbb596-d9bc-4ffb-bd76-55c53de6d337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.391192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 785/1552] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.392353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70e86d-69f7-48a2-9871-317c0b9945d5 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.402606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70e86d-69f7-48a2-9871-317c0b9945d5 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.406694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-35bbb596-d9bc-4ffb-bd76-55c53de6d337 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.407182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307ce8c-8077-4c77-9e98-16f065d07ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.407821 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307ce8c-8077-4c77-9e98-16f065d07ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.407950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-35bbb596-d9bc-4ffb-bd76-55c53de6d337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.408110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307ce8c-8077-4c77-9e98-16f065d07ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.408390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307ce8c-8077-4c77-9e98-16f065d07ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.409034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307ce8c-8077-4c77-9e98-16f065d07ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.410624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307ce8c-8077-4c77-9e98-16f065d07ef4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.416906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 768/1553] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.418332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b701c-36a4-4268-935f-bafc5c4183c3 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.418623 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b701c-36a4-4268-935f-bafc5c4183c3 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.418922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b701c-36a4-4268-935f-bafc5c4183c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.422748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 786/1554] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:44.424562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9169-8b8e-4c1c-9ddb-b63a05de902f None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.424839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9169-8b8e-4c1c-9ddb-b63a05de902f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.426156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9169-8b8e-4c1c-9ddb-b63a05de902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.443529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-794b701c-36a4-4268-935f-bafc5c4183c3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.444790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-794b701c-36a4-4268-935f-bafc5c4183c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.448629 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-019a9169-8b8e-4c1c-9ddb-b63a05de902f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.449845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-019a9169-8b8e-4c1c-9ddb-b63a05de902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.452928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 769/1555] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.454095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e846c-b46e-4786-8112-ffb5b039609f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.454374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e846c-b46e-4786-8112-ffb5b039609f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.454649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e846c-b46e-4786-8112-ffb5b039609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.460986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 787/1556] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.461981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a9169-8b8e-4c1c-9ddb-b63a05de902f None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.471612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a9169-8b8e-4c1c-9ddb-b63a05de902f None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.476735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c150ef-68b7-432d-9711-39ce7b73aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.477348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c150ef-68b7-432d-9711-39ce7b73aee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.477602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-525e846c-b46e-4786-8112-ffb5b039609f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.477748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c150ef-68b7-432d-9711-39ce7b73aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.477907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c150ef-68b7-432d-9711-39ce7b73aee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.478589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c150ef-68b7-432d-9711-39ce7b73aee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:17:44.478806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-525e846c-b46e-4786-8112-ffb5b039609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.479041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c150ef-68b7-432d-9711-39ce7b73aee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.479990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WARNING py.warnings [None req-34c150ef-68b7-432d-9711-39ce7b73aee6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:17:44.479990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: warnings.warn(msg) Sep 09 12:17:44.479990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: Sep 09 12:17:44.480838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c150ef-68b7-432d-9711-39ce7b73aee6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.493404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 788/1557] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:17:44.502533 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee183-8ee5-40e7-a645-becdb715a65b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.502533 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee183-8ee5-40e7-a645-becdb715a65b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.502533 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee183-8ee5-40e7-a645-becdb715a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.502878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 770/1558] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.502878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e846c-b46e-4786-8112-ffb5b039609f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.512404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e846c-b46e-4786-8112-ffb5b039609f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.517425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2458-eed7-4339-851f-d23953122426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.518036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2458-eed7-4339-851f-d23953122426 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.518321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2458-eed7-4339-851f-d23953122426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.518768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2458-eed7-4339-851f-d23953122426 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.518881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e23ee183-8ee5-40e7-a645-becdb715a65b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.519437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e2458-eed7-4339-851f-d23953122426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:17:44.519811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e2458-eed7-4339-851f-d23953122426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.520142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e23ee183-8ee5-40e7-a645-becdb715a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.522023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e2458-eed7-4339-851f-d23953122426 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.528937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 789/1559] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.530115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a124d50-f59d-4439-a62a-e80f20bfe8a3 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.530409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a124d50-f59d-4439-a62a-e80f20bfe8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.530692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a124d50-f59d-4439-a62a-e80f20bfe8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.540895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 771/1560] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:17:44.540895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2458-eed7-4339-851f-d23953122426 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.550941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2458-eed7-4339-851f-d23953122426 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.555884 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-0a124d50-f59d-4439-a62a-e80f20bfe8a3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:44.556035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1c01-7bfb-44ab-b8e4-5ee771c1f862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.556642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1c01-7bfb-44ab-b8e4-5ee771c1f862 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.556929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1c01-7bfb-44ab-b8e4-5ee771c1f862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.557084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0a124d50-f59d-4439-a62a-e80f20bfe8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:44.557273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1c01-7bfb-44ab-b8e4-5ee771c1f862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.557917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1c01-7bfb-44ab-b8e4-5ee771c1f862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.559682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1c01-7bfb-44ab-b8e4-5ee771c1f862 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.565478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 790/1561] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:44.570418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a124d50-f59d-4439-a62a-e80f20bfe8a3 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.574108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 772/1562] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:44.574108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1c01-7bfb-44ab-b8e4-5ee771c1f862 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.580517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a124d50-f59d-4439-a62a-e80f20bfe8a3 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.582442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1c01-7bfb-44ab-b8e4-5ee771c1f862 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.586613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f472d9-fea8-45ea-9633-0347846a54db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.587157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f472d9-fea8-45ea-9633-0347846a54db admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.587440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f472d9-fea8-45ea-9633-0347846a54db admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.587761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f472d9-fea8-45ea-9633-0347846a54db admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.588232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27436a-0f51-4394-b6e1-fd895ffdc214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.588409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f472d9-fea8-45ea-9633-0347846a54db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:17:44.588719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f472d9-fea8-45ea-9633-0347846a54db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.588825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27436a-0f51-4394-b6e1-fd895ffdc214 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.589131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27436a-0f51-4394-b6e1-fd895ffdc214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.589406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27436a-0f51-4394-b6e1-fd895ffdc214 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.590044 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27436a-0f51-4394-b6e1-fd895ffdc214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:17:44.590322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f472d9-fea8-45ea-9633-0347846a54db admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.590467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27436a-0f51-4394-b6e1-fd895ffdc214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.591979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27436a-0f51-4394-b6e1-fd895ffdc214 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.602606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 791/1563] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:17:44.607342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f472d9-fea8-45ea-9633-0347846a54db admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.607458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 773/1564] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:17:44.607458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27436a-0f51-4394-b6e1-fd895ffdc214 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.615756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27436a-0f51-4394-b6e1-fd895ffdc214 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.616218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f472d9-fea8-45ea-9633-0347846a54db admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.621191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d039-4544-4ff0-8f0d-b3e5416c8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.621342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ea04-8edf-48d1-a4a2-e3924e243ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.621795 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d039-4544-4ff0-8f0d-b3e5416c8b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.621907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ea04-8edf-48d1-a4a2-e3924e243ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.622074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ea04-8edf-48d1-a4a2-e3924e243ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.622180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d039-4544-4ff0-8f0d-b3e5416c8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.622343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d039-4544-4ff0-8f0d-b3e5416c8b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.622444 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ea04-8edf-48d1-a4a2-e3924e243ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.622967 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ea04-8edf-48d1-a4a2-e3924e243ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.623066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41d039-4544-4ff0-8f0d-b3e5416c8b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:17:44.623267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41d039-4544-4ff0-8f0d-b3e5416c8b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.624036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WARNING py.warnings [None req-e425ea04-8edf-48d1-a4a2-e3924e243ecf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:17:44.624036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: warnings.warn(msg) Sep 09 12:17:44.624036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: Sep 09 12:17:44.625212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ea04-8edf-48d1-a4a2-e3924e243ecf admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.625543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41d039-4544-4ff0-8f0d-b3e5416c8b2b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.640124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 792/1565] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:17:44.648565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d039-4544-4ff0-8f0d-b3e5416c8b2b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.658359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d039-4544-4ff0-8f0d-b3e5416c8b2b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.663389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5f26-6c0e-48a9-bf85-e1a43a026c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.664119 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5f26-6c0e-48a9-bf85-e1a43a026c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.664402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5f26-6c0e-48a9-bf85-e1a43a026c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.664680 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5f26-6c0e-48a9-bf85-e1a43a026c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.665352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d5f26-6c0e-48a9-bf85-e1a43a026c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:17:44.665658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d5f26-6c0e-48a9-bf85-e1a43a026c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.667245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d5f26-6c0e-48a9-bf85-e1a43a026c26 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.679705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 793/1566] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:17:44.680491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5f26-6c0e-48a9-bf85-e1a43a026c26 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.690095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5f26-6c0e-48a9-bf85-e1a43a026c26 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.695276 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35714f1e-a729-43d9-9863-e4b65ed272f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.695894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35714f1e-a729-43d9-9863-e4b65ed272f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.696163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35714f1e-a729-43d9-9863-e4b65ed272f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.696437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35714f1e-a729-43d9-9863-e4b65ed272f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.697062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35714f1e-a729-43d9-9863-e4b65ed272f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.698909 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35714f1e-a729-43d9-9863-e4b65ed272f4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.704237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:44.722706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 774/1567] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:44.723756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ea04-8edf-48d1-a4a2-e3924e243ecf admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.762512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:44.783187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 794/1568] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:44.783187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35714f1e-a729-43d9-9863-e4b65ed272f4 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.788260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ea04-8edf-48d1-a4a2-e3924e243ecf admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.843203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35714f1e-a729-43d9-9863-e4b65ed272f4 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.845705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab83bf1-a258-42f9-a807-d4d3b0f52e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.846358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab83bf1-a258-42f9-a807-d4d3b0f52e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.846779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab83bf1-a258-42f9-a807-d4d3b0f52e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.847064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab83bf1-a258-42f9-a807-d4d3b0f52e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.847738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab83bf1-a258-42f9-a807-d4d3b0f52e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:17:44.848070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab83bf1-a258-42f9-a807-d4d3b0f52e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.848215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260008-28a3-4b1f-abc0-bcb964e9118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.848989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260008-28a3-4b1f-abc0-bcb964e9118e admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.849275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260008-28a3-4b1f-abc0-bcb964e9118e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.849548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260008-28a3-4b1f-abc0-bcb964e9118e admin admin] PATH_INFO: `/v3/projects/c26f3b568b0645a79572ac4b973903db/users/504c97036895408b9e04deb0792d5576/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.849731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab83bf1-a258-42f9-a807-d4d3b0f52e13 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.861688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 775/1569] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:17:44.862318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab83bf1-a258-42f9-a807-d4d3b0f52e13 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.868571 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95260008-28a3-4b1f-abc0-bcb964e9118e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26f3b568b0645a79572ac4b973903db, user_id=504c97036895408b9e04deb0792d5576, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.871281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95260008-28a3-4b1f-abc0-bcb964e9118e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.876377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab83bf1-a258-42f9-a807-d4d3b0f52e13 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:44.882225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf55f9-a0bd-4191-8f69-6fd9f1b9e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:44.882830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf55f9-a0bd-4191-8f69-6fd9f1b9e44b admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:44.883113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf55f9-a0bd-4191-8f69-6fd9f1b9e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:44.883388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf55f9-a0bd-4191-8f69-6fd9f1b9e44b admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:44.884056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf55f9-a0bd-4191-8f69-6fd9f1b9e44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:44.886056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf55f9-a0bd-4191-8f69-6fd9f1b9e44b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:44.955575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 795/1570] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:44 2022] PUT /identity/v3/projects/c26f3b568b0645a79572ac4b973903db/users/504c97036895408b9e04deb0792d5576/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:44.956534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260008-28a3-4b1f-abc0-bcb964e9118e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:44.985841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 776/1571] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:44.987685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf55f9-a0bd-4191-8f69-6fd9f1b9e44b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.022951 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260008-28a3-4b1f-abc0-bcb964e9118e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.052201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf55f9-a0bd-4191-8f69-6fd9f1b9e44b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.057452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0224e49-40ff-4d9c-b329-6b79b80bf337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.058090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0224e49-40ff-4d9c-b329-6b79b80bf337 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.058373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0224e49-40ff-4d9c-b329-6b79b80bf337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.058648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0224e49-40ff-4d9c-b329-6b79b80bf337 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.059281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0224e49-40ff-4d9c-b329-6b79b80bf337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.061242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0224e49-40ff-4d9c-b329-6b79b80bf337 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.079366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e319f-00b0-4139-a80f-ef21e5d7b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.080010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e319f-00b0-4139-a80f-ef21e5d7b60e admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.080292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e319f-00b0-4139-a80f-ef21e5d7b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.080562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e319f-00b0-4139-a80f-ef21e5d7b60e admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.081187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e319f-00b0-4139-a80f-ef21e5d7b60e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.083333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e319f-00b0-4139-a80f-ef21e5d7b60e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.173935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 777/1572] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.173935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0224e49-40ff-4d9c-b329-6b79b80bf337 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.197742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 796/1573] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:44 2022] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.199323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e319f-00b0-4139-a80f-ef21e5d7b60e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.205290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:45.218605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:45.237530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0224e49-40ff-4d9c-b329-6b79b80bf337 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.265067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e319f-00b0-4139-a80f-ef21e5d7b60e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.269846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400cb5-d105-420a-886f-bf37e311a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.270463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400cb5-d105-420a-886f-bf37e311a05b admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.270736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400cb5-d105-420a-886f-bf37e311a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.271007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400cb5-d105-420a-886f-bf37e311a05b admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.271696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400cb5-d105-420a-886f-bf37e311a05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.273664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400cb5-d105-420a-886f-bf37e311a05b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.297204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8d2e2-b3a7-4e55-8df9-a6440f2a284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.297841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8d2e2-b3a7-4e55-8df9-a6440f2a284e admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.298117 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8d2e2-b3a7-4e55-8df9-a6440f2a284e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.298388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8d2e2-b3a7-4e55-8df9-a6440f2a284e admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.299007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8d2e2-b3a7-4e55-8df9-a6440f2a284e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.300921 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8d2e2-b3a7-4e55-8df9-a6440f2a284e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.383192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 797/1574] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.384196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400cb5-d105-420a-886f-bf37e311a05b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.385304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 778/1575] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.386373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8d2e2-b3a7-4e55-8df9-a6440f2a284e admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.394469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400cb5-d105-420a-886f-bf37e311a05b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.450969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8d2e2-b3a7-4e55-8df9-a6440f2a284e admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.452773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1be8c0-4c02-4b03-98a1-d6fe8e8cedb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.453384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1be8c0-4c02-4b03-98a1-d6fe8e8cedb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.453660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1be8c0-4c02-4b03-98a1-d6fe8e8cedb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.453931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1be8c0-4c02-4b03-98a1-d6fe8e8cedb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.454674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1be8c0-4c02-4b03-98a1-d6fe8e8cedb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.455728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ac7cc-758a-4617-8352-1351b3d575df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.456336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ac7cc-758a-4617-8352-1351b3d575df admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.456596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1be8c0-4c02-4b03-98a1-d6fe8e8cedb0 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.456729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ac7cc-758a-4617-8352-1351b3d575df admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.456907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ac7cc-758a-4617-8352-1351b3d575df admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.457797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ac7cc-758a-4617-8352-1351b3d575df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.459681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ac7cc-758a-4617-8352-1351b3d575df admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.560937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 798/1576] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/users => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.562347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f28ae4-1e27-45ff-a986-643eafa53235 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.562641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f28ae4-1e27-45ff-a986-643eafa53235 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.562918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f28ae4-1e27-45ff-a986-643eafa53235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.582785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e8f28ae4-1e27-45ff-a986-643eafa53235 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:45.586891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e8f28ae4-1e27-45ff-a986-643eafa53235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:45.587021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 779/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/projects => generated 393 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.587021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ac7cc-758a-4617-8352-1351b3d575df admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.648611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 799/1578] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:45.649179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f28ae4-1e27-45ff-a986-643eafa53235 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.653127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:45.657178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ac7cc-758a-4617-8352-1351b3d575df admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.659158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f28ae4-1e27-45ff-a986-643eafa53235 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.662994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7b7b1-bd39-4327-8c24-f987e3187c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.663616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7b7b1-bd39-4327-8c24-f987e3187c66 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.663929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7b7b1-bd39-4327-8c24-f987e3187c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.664208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7b7b1-bd39-4327-8c24-f987e3187c66 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.664413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7600-2025-4703-86b3-4f6e2ab5cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.664845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7b7b1-bd39-4327-8c24-f987e3187c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.665016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7600-2025-4703-86b3-4f6e2ab5cf44 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.665300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7600-2025-4703-86b3-4f6e2ab5cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.665573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7600-2025-4703-86b3-4f6e2ab5cf44 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.666205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7600-2025-4703-86b3-4f6e2ab5cf44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.666794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7b7b1-bd39-4327-8c24-f987e3187c66 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.668247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7600-2025-4703-86b3-4f6e2ab5cf44 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.795587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 780/1579] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.796599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7b7b1-bd39-4327-8c24-f987e3187c66 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.806428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7b7b1-bd39-4327-8c24-f987e3187c66 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.811064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385ba13-0fa2-493b-b558-3da7c9c1006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.811683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385ba13-0fa2-493b-b558-3da7c9c1006d admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.811967 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385ba13-0fa2-493b-b558-3da7c9c1006d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.812240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385ba13-0fa2-493b-b558-3da7c9c1006d admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.812863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385ba13-0fa2-493b-b558-3da7c9c1006d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.814770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385ba13-0fa2-493b-b558-3da7c9c1006d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.824034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 800/1580] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.825242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7600-2025-4703-86b3-4f6e2ab5cf44 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.831574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:45.836043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7600-2025-4703-86b3-4f6e2ab5cf44 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.840608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f7425-e04a-4e6d-b9b5-f40a0e0c291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.841198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f7425-e04a-4e6d-b9b5-f40a0e0c291a admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.841477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f7425-e04a-4e6d-b9b5-f40a0e0c291a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.841747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f7425-e04a-4e6d-b9b5-f40a0e0c291a admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.842403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f7425-e04a-4e6d-b9b5-f40a0e0c291a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.844013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f7425-e04a-4e6d-b9b5-f40a0e0c291a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.855614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 801/1581] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:45.856605 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f7425-e04a-4e6d-b9b5-f40a0e0c291a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.865990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f7425-e04a-4e6d-b9b5-f40a0e0c291a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.870736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ab6d-cee6-4899-a0a8-ff278a862f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.871338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ab6d-cee6-4899-a0a8-ff278a862f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.872240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ab6d-cee6-4899-a0a8-ff278a862f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.872513 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ab6d-cee6-4899-a0a8-ff278a862f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.873137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ab6d-cee6-4899-a0a8-ff278a862f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.875103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ab6d-cee6-4899-a0a8-ff278a862f05 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.898972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 781/1582] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.899981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385ba13-0fa2-493b-b558-3da7c9c1006d admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.909831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385ba13-0fa2-493b-b558-3da7c9c1006d admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.915200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b20ab-0485-4756-aefc-b639b53409f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.915827 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b20ab-0485-4756-aefc-b639b53409f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.916119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b20ab-0485-4756-aefc-b639b53409f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.916398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b20ab-0485-4756-aefc-b639b53409f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.917051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b20ab-0485-4756-aefc-b639b53409f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.918619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b20ab-0485-4756-aefc-b639b53409f2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.929201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 782/1583] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:45.930094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b20ab-0485-4756-aefc-b639b53409f2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:45.939430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b20ab-0485-4756-aefc-b639b53409f2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:45.944338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348fbe9-b98a-4ddf-9b9f-66a46a5b7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:45.945176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348fbe9-b98a-4ddf-9b9f-66a46a5b7798 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:45.945176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348fbe9-b98a-4ddf-9b9f-66a46a5b7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:45.945430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348fbe9-b98a-4ddf-9b9f-66a46a5b7798 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:45.946043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348fbe9-b98a-4ddf-9b9f-66a46a5b7798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:45.947960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348fbe9-b98a-4ddf-9b9f-66a46a5b7798 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:45.952851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 802/1584] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:45.952851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ab6d-cee6-4899-a0a8-ff278a862f05 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.004611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ab6d-cee6-4899-a0a8-ff278a862f05 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.008872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bfd3e-83d5-48c4-a2b5-d89f1c876a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.009473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bfd3e-83d5-48c4-a2b5-d89f1c876a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.009753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bfd3e-83d5-48c4-a2b5-d89f1c876a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.010026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bfd3e-83d5-48c4-a2b5-d89f1c876a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.018881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bfd3e-83d5-48c4-a2b5-d89f1c876a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.020408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bfd3e-83d5-48c4-a2b5-d89f1c876a27 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.032713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 783/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:45 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:46.032928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 803/1586] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:46.033037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348fbe9-b98a-4ddf-9b9f-66a46a5b7798 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.033151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bfd3e-83d5-48c4-a2b5-d89f1c876a27 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.042759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348fbe9-b98a-4ddf-9b9f-66a46a5b7798 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.043322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bfd3e-83d5-48c4-a2b5-d89f1c876a27 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.047701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e55c-cc4e-43b8-b9ca-c70a2cddb979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.048624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e55c-cc4e-43b8-b9ca-c70a2cddb979 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.048872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e55c-cc4e-43b8-b9ca-c70a2cddb979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.049001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88b7e-c473-4865-9d16-72414cbb97a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.049362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e55c-cc4e-43b8-b9ca-c70a2cddb979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.049694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88b7e-c473-4865-9d16-72414cbb97a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.049987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88b7e-c473-4865-9d16-72414cbb97a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.050268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88b7e-c473-4865-9d16-72414cbb97a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.050379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e55c-cc4e-43b8-b9ca-c70a2cddb979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.050919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e88b7e-c473-4865-9d16-72414cbb97a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.052206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e55c-cc4e-43b8-b9ca-c70a2cddb979 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.052601 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e88b7e-c473-4865-9d16-72414cbb97a3 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.063400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 804/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.065784 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88b7e-c473-4865-9d16-72414cbb97a3 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.066694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 784/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.067593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e55c-cc4e-43b8-b9ca-c70a2cddb979 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.076722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88b7e-c473-4865-9d16-72414cbb97a3 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.078171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e55c-cc4e-43b8-b9ca-c70a2cddb979 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.081585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b28c85-b283-4328-9969-4fdab5c004d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.082440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b28c85-b283-4328-9969-4fdab5c004d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.082725 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b28c85-b283-4328-9969-4fdab5c004d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.082997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b28c85-b283-4328-9969-4fdab5c004d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.083200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553d392-3d5b-4b03-8614-9b5cdf5385c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.083649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b28c85-b283-4328-9969-4fdab5c004d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.084447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553d392-3d5b-4b03-8614-9b5cdf5385c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.084787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553d392-3d5b-4b03-8614-9b5cdf5385c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.085118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553d392-3d5b-4b03-8614-9b5cdf5385c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.085684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553d392-3d5b-4b03-8614-9b5cdf5385c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.085828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b28c85-b283-4328-9969-4fdab5c004d0 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.087286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553d392-3d5b-4b03-8614-9b5cdf5385c4 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.096520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 805/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.097482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b28c85-b283-4328-9969-4fdab5c004d0 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.099180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 785/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.100817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553d392-3d5b-4b03-8614-9b5cdf5385c4 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.109307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b28c85-b283-4328-9969-4fdab5c004d0 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.111390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553d392-3d5b-4b03-8614-9b5cdf5385c4 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.120069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de4d6-7c2a-4f3d-bef1-62c7d7c03da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.120695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de4d6-7c2a-4f3d-bef1-62c7d7c03da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.121023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de4d6-7c2a-4f3d-bef1-62c7d7c03da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.121260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de4d6-7c2a-4f3d-bef1-62c7d7c03da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.121904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33de4d6-7c2a-4f3d-bef1-62c7d7c03da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.123531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33de4d6-7c2a-4f3d-bef1-62c7d7c03da7 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.127110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c70cf-ac3c-4e66-8562-4db5dad2ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.127770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c70cf-ac3c-4e66-8562-4db5dad2ec9a admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.128059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c70cf-ac3c-4e66-8562-4db5dad2ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.128341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c70cf-ac3c-4e66-8562-4db5dad2ec9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.128986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c70cf-ac3c-4e66-8562-4db5dad2ec9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.131322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c70cf-ac3c-4e66-8562-4db5dad2ec9a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.137414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 786/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.138304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de4d6-7c2a-4f3d-bef1-62c7d7c03da7 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.143916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 806/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.143916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c70cf-ac3c-4e66-8562-4db5dad2ec9a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.153271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de4d6-7c2a-4f3d-bef1-62c7d7c03da7 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.154750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c70cf-ac3c-4e66-8562-4db5dad2ec9a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.157883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f13dd-99cc-4d2a-afe2-47bc4961253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.158471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f13dd-99cc-4d2a-afe2-47bc4961253e admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.158746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f13dd-99cc-4d2a-afe2-47bc4961253e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.159017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f13dd-99cc-4d2a-afe2-47bc4961253e admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.159775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f13dd-99cc-4d2a-afe2-47bc4961253e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.160033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b4f9-941e-4011-bdba-cee512774796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.160658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b4f9-941e-4011-bdba-cee512774796 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.160942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b4f9-941e-4011-bdba-cee512774796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.161486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b4f9-941e-4011-bdba-cee512774796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.161588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f13dd-99cc-4d2a-afe2-47bc4961253e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.162180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94b4f9-941e-4011-bdba-cee512774796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.163793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94b4f9-941e-4011-bdba-cee512774796 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.173193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 787/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.178869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f13dd-99cc-4d2a-afe2-47bc4961253e admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.179004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 807/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.179004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b4f9-941e-4011-bdba-cee512774796 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.183878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f13dd-99cc-4d2a-afe2-47bc4961253e admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.189432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087f69e-4cab-4cd3-84cb-86d3144b6f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.189621 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b4f9-941e-4011-bdba-cee512774796 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.190058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087f69e-4cab-4cd3-84cb-86d3144b6f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.190341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087f69e-4cab-4cd3-84cb-86d3144b6f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.190617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087f69e-4cab-4cd3-84cb-86d3144b6f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.191246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087f69e-4cab-4cd3-84cb-86d3144b6f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.192871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087f69e-4cab-4cd3-84cb-86d3144b6f29 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.195115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59cdfc-f2bb-4d33-b206-8f5711b25bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.195781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59cdfc-f2bb-4d33-b206-8f5711b25bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.196127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59cdfc-f2bb-4d33-b206-8f5711b25bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.196393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59cdfc-f2bb-4d33-b206-8f5711b25bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.197040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59cdfc-f2bb-4d33-b206-8f5711b25bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.198712 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59cdfc-f2bb-4d33-b206-8f5711b25bf4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.208878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 788/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.208878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087f69e-4cab-4cd3-84cb-86d3144b6f29 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.215530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 808/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.215530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59cdfc-f2bb-4d33-b206-8f5711b25bf4 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.220893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087f69e-4cab-4cd3-84cb-86d3144b6f29 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.230368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb505957-2520-4892-9857-69476d6b63ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.231094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb505957-2520-4892-9857-69476d6b63ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.233793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb505957-2520-4892-9857-69476d6b63ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.233793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb505957-2520-4892-9857-69476d6b63ce admin admin] PATH_INFO: `/v3/projects/3b175fa3bc0449738bc0132b165b7d5c/users/9aaf5614887b4f4f882da8d142f130d3/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.234164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59cdfc-f2bb-4d33-b206-8f5711b25bf4 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.240317 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a389cd2-165b-4fcc-804b-910b6950ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.240935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a389cd2-165b-4fcc-804b-910b6950ee22 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.241218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a389cd2-165b-4fcc-804b-910b6950ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.241491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a389cd2-165b-4fcc-804b-910b6950ee22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.242137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a389cd2-165b-4fcc-804b-910b6950ee22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.243776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a389cd2-165b-4fcc-804b-910b6950ee22 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.247532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb505957-2520-4892-9857-69476d6b63ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b175fa3bc0449738bc0132b165b7d5c, user_id=9aaf5614887b4f4f882da8d142f130d3, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.248605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WARNING py.warnings [None req-cb505957-2520-4892-9857-69476d6b63ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:17:46.248605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: warnings.warn(msg) Sep 09 12:17:46.248605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: Sep 09 12:17:46.250525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb505957-2520-4892-9857-69476d6b63ce admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.254353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 809/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.255245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a389cd2-165b-4fcc-804b-910b6950ee22 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.265747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a389cd2-165b-4fcc-804b-910b6950ee22 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.270376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20951b-ec0b-4cc3-afcc-5730cfb46f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.271009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20951b-ec0b-4cc3-afcc-5730cfb46f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.271345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20951b-ec0b-4cc3-afcc-5730cfb46f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.272158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20951b-ec0b-4cc3-afcc-5730cfb46f0f admin admin] PATH_INFO: `/v3/projects/5a65efebb1f942528f91f1d8de76aff7/users/f67e1f2019704894be94e6ff6f81be2d/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.289064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20951b-ec0b-4cc3-afcc-5730cfb46f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a65efebb1f942528f91f1d8de76aff7, user_id=f67e1f2019704894be94e6ff6f81be2d, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.291925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20951b-ec0b-4cc3-afcc-5730cfb46f0f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.355962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 789/1598] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:46 2022] PUT /identity/v3/projects/3b175fa3bc0449738bc0132b165b7d5c/users/9aaf5614887b4f4f882da8d142f130d3/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:46.357114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb505957-2520-4892-9857-69476d6b63ce admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.420186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 810/1599] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:46 2022] PUT /identity/v3/projects/5a65efebb1f942528f91f1d8de76aff7/users/f67e1f2019704894be94e6ff6f81be2d/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:46.424453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20951b-ec0b-4cc3-afcc-5730cfb46f0f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.441627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb505957-2520-4892-9857-69476d6b63ce admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.469123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:46.473873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:46.489186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20951b-ec0b-4cc3-afcc-5730cfb46f0f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.495164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed21ae-687f-4f66-aeb2-0304372effc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.495701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed21ae-687f-4f66-aeb2-0304372effc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.495979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed21ae-687f-4f66-aeb2-0304372effc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.496647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed21ae-687f-4f66-aeb2-0304372effc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.497283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed21ae-687f-4f66-aeb2-0304372effc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.498885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed21ae-687f-4f66-aeb2-0304372effc4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.503658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5403c-dbc2-46bf-9c11-bc439737fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.504339 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5403c-dbc2-46bf-9c11-bc439737fe4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.504627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5403c-dbc2-46bf-9c11-bc439737fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.504976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5403c-dbc2-46bf-9c11-bc439737fe4c admin admin] PATH_INFO: `/v3/projects/689698d187974bd1ba50e44be080a6f5/users/be0f76350dc148c6b51705693a1902c4/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.510898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 811/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:46.512189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed21ae-687f-4f66-aeb2-0304372effc4 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.524717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5403c-dbc2-46bf-9c11-bc439737fe4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=689698d187974bd1ba50e44be080a6f5, user_id=be0f76350dc148c6b51705693a1902c4, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.524947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed21ae-687f-4f66-aeb2-0304372effc4 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.527713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5403c-dbc2-46bf-9c11-bc439737fe4c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.531355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf0dce-132c-453e-a84a-8262a6c75d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.532293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf0dce-132c-453e-a84a-8262a6c75d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.532649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf0dce-132c-453e-a84a-8262a6c75d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.532975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf0dce-132c-453e-a84a-8262a6c75d2a admin admin] PATH_INFO: `/v3/projects/3245db2d90184139bab184731e1b37cf/users/928736b5b6c54982a7d5de64ce546c38/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.551028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf0dce-132c-453e-a84a-8262a6c75d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3245db2d90184139bab184731e1b37cf, user_id=928736b5b6c54982a7d5de64ce546c38, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.554287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf0dce-132c-453e-a84a-8262a6c75d2a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.601806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 790/1601] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:46 2022] PUT /identity/v3/projects/689698d187974bd1ba50e44be080a6f5/users/be0f76350dc148c6b51705693a1902c4/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:46.603406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5403c-dbc2-46bf-9c11-bc439737fe4c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.627073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 812/1602] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:46 2022] PUT /identity/v3/projects/3245db2d90184139bab184731e1b37cf/users/928736b5b6c54982a7d5de64ce546c38/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:46.627073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf0dce-132c-453e-a84a-8262a6c75d2a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.702148 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5403c-dbc2-46bf-9c11-bc439737fe4c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.706755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed8999-1df2-4061-8ed5-36b60bb93488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.707712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed8999-1df2-4061-8ed5-36b60bb93488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.708027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed8999-1df2-4061-8ed5-36b60bb93488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.710617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed8999-1df2-4061-8ed5-36b60bb93488 admin admin] PATH_INFO: `/v3/projects/627acef0c9154338bcd5e8befe476cb1/users/9df44d7e1b874671aec8ee0ddfed403b/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.711231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf0dce-132c-453e-a84a-8262a6c75d2a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.716059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaaf3c-f470-4944-aec3-53eace8ea81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.724492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaaf3c-f470-4944-aec3-53eace8ea81e admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.724492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaaf3c-f470-4944-aec3-53eace8ea81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.724492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaaf3c-f470-4944-aec3-53eace8ea81e admin admin] PATH_INFO: `/v3/projects/02a895cb05f340a7ba92b3da268c0d48/users/16e25d8988c7443ebb75ce45dba61352/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.727981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed8999-1df2-4061-8ed5-36b60bb93488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627acef0c9154338bcd5e8befe476cb1, user_id=9df44d7e1b874671aec8ee0ddfed403b, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.730824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed8999-1df2-4061-8ed5-36b60bb93488 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.732850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaaf3c-f470-4944-aec3-53eace8ea81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a895cb05f340a7ba92b3da268c0d48, user_id=16e25d8988c7443ebb75ce45dba61352, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.735560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaaf3c-f470-4944-aec3-53eace8ea81e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:46.836670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 791/1604] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:46 2022] PUT /identity/v3/projects/627acef0c9154338bcd5e8befe476cb1/users/9df44d7e1b874671aec8ee0ddfed403b/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:46.840270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40f483-3c00-4278-9efe-5b1573f9994d None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.840270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40f483-3c00-4278-9efe-5b1573f9994d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.840270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40f483-3c00-4278-9efe-5b1573f9994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.846485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 813/1604] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:46 2022] PUT /identity/v3/projects/02a895cb05f340a7ba92b3da268c0d48/users/16e25d8988c7443ebb75ce45dba61352/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:46.848642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434867c-d3af-4837-b40e-289c4ba12414 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.849089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434867c-d3af-4837-b40e-289c4ba12414 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.850102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434867c-d3af-4837-b40e-289c4ba12414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.872534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-a434867c-d3af-4837-b40e-289c4ba12414 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:46.873762 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a434867c-d3af-4837-b40e-289c4ba12414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:46.876491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-2f40f483-3c00-4278-9efe-5b1573f9994d None None] MFA Rules not processed for user `9aaf5614887b4f4f882da8d142f130d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:46.877871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2f40f483-3c00-4278-9efe-5b1573f9994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:46.941072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 814/1605] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:46.941828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434867c-d3af-4837-b40e-289c4ba12414 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:46.949278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 792/1606] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:46.956672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a22a1-13f1-482f-b71a-c0d7e56b4500 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.956810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434867c-d3af-4837-b40e-289c4ba12414 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:46.956908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a22a1-13f1-482f-b71a-c0d7e56b4500 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.956908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a22a1-13f1-482f-b71a-c0d7e56b4500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.957579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ac52c-3949-49ff-9732-1137c598dbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:46.958523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ac52c-3949-49ff-9732-1137c598dbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.958879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ac52c-3949-49ff-9732-1137c598dbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.959262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ac52c-3949-49ff-9732-1137c598dbf9 admin admin] PATH_INFO: `/v3/projects/bcf0d743dc7d4a03bdab2098b2e5fae0/users/04c3b6e933a9414593d7552aa960967d/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.972373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a16a22a1-13f1-482f-b71a-c0d7e56b4500 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:46.973579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a16a22a1-13f1-482f-b71a-c0d7e56b4500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:46.982765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 793/1607] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:46.984074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e27c-4493-4979-bf0e-d7128d480e02 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:46.986666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e27c-4493-4979-bf0e-d7128d480e02 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:46.986666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e27c-4493-4979-bf0e-d7128d480e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:46.986950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ac52c-3949-49ff-9732-1137c598dbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf0d743dc7d4a03bdab2098b2e5fae0, user_id=04c3b6e933a9414593d7552aa960967d, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:46.989882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ac52c-3949-49ff-9732-1137c598dbf9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:47.019207 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ec07e27c-4493-4979-bf0e-d7128d480e02 None None] MFA Rules not processed for user `928736b5b6c54982a7d5de64ce546c38`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:47.020658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ec07e27c-4493-4979-bf0e-d7128d480e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:47.026332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:47.090724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 794/1608] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:47.092031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966af79-0b8e-417a-97c8-ad7253f391a7 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.092320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966af79-0b8e-417a-97c8-ad7253f391a7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.092591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966af79-0b8e-417a-97c8-ad7253f391a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.105261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 815/1609] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:46 2022] PUT /identity/v3/projects/bcf0d743dc7d4a03bdab2098b2e5fae0/users/04c3b6e933a9414593d7552aa960967d/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:47.106519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37540f-bcfd-4d64-9055-35e2ba94103b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.106816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37540f-bcfd-4d64-9055-35e2ba94103b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.107085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37540f-bcfd-4d64-9055-35e2ba94103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.118051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b966af79-0b8e-417a-97c8-ad7253f391a7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:47.119272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b966af79-0b8e-417a-97c8-ad7253f391a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:47.143486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5d37540f-bcfd-4d64-9055-35e2ba94103b None None] MFA Rules not processed for user `16e25d8988c7443ebb75ce45dba61352`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:47.144526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5d37540f-bcfd-4d64-9055-35e2ba94103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:47.153752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:47.187213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 795/1610] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:47.188183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966af79-0b8e-417a-97c8-ad7253f391a7 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:47.216259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 816/1611] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:47.217337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ef8f7-beee-4fa5-b561-c8aa4e5881e5 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.217624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ef8f7-beee-4fa5-b561-c8aa4e5881e5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.217898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ef8f7-beee-4fa5-b561-c8aa4e5881e5 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.219125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 817/1612] 10.222.0.27 () {54 vars in 962 bytes} [Fri Sep 9 12:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:17:47.219862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ef8f7-beee-4fa5-b561-c8aa4e5881e5 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:47.221594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-692ef8f7-beee-4fa5-b561-c8aa4e5881e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:47.248342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966af79-0b8e-417a-97c8-ad7253f391a7 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:47.252006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6dfd18-9a63-4d38-8b2d-940909a8d7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:47.252615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6dfd18-9a63-4d38-8b2d-940909a8d7bd service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.252903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6dfd18-9a63-4d38-8b2d-940909a8d7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.253160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6dfd18-9a63-4d38-8b2d-940909a8d7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.265295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6dfd18-9a63-4d38-8b2d-940909a8d7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:47.266807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6dfd18-9a63-4d38-8b2d-940909a8d7bd service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:47.278231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 796/1613] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:47.279137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6dfd18-9a63-4d38-8b2d-940909a8d7bd service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:47.297813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6dfd18-9a63-4d38-8b2d-940909a8d7bd service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:47.301756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ef8f7-beee-4fa5-b561-c8aa4e5881e5 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:47.308493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94c1a6-cafc-4d17-a79f-462db15426a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:47.309108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94c1a6-cafc-4d17-a79f-462db15426a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.309448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94c1a6-cafc-4d17-a79f-462db15426a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.309726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94c1a6-cafc-4d17-a79f-462db15426a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.310411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94c1a6-cafc-4d17-a79f-462db15426a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:47.311443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387def-249e-4e95-aba3-070d4b294d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:47.313172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387def-249e-4e95-aba3-070d4b294d81 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.313315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94c1a6-cafc-4d17-a79f-462db15426a4 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:47.313841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387def-249e-4e95-aba3-070d4b294d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.317989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387def-249e-4e95-aba3-070d4b294d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.337783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30387def-249e-4e95-aba3-070d4b294d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:47.339363 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30387def-249e-4e95-aba3-070d4b294d81 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:47.350651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 818/1614] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:47.353356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612d840-dce6-475a-aebd-293322606d2f None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.353356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612d840-dce6-475a-aebd-293322606d2f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.353356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612d840-dce6-475a-aebd-293322606d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.372233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4612d840-dce6-475a-aebd-293322606d2f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:47.374036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4612d840-dce6-475a-aebd-293322606d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:47.383376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 819/1615] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:47.385890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612d840-dce6-475a-aebd-293322606d2f None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:47.396940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612d840-dce6-475a-aebd-293322606d2f None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:47.400918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863e373-3087-4ab3-b3c6-37963bcdc182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:47.401609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863e373-3087-4ab3-b3c6-37963bcdc182 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.401958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863e373-3087-4ab3-b3c6-37963bcdc182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.402880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863e373-3087-4ab3-b3c6-37963bcdc182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.413303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863e373-3087-4ab3-b3c6-37963bcdc182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:47.415314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863e373-3087-4ab3-b3c6-37963bcdc182 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:47.424845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 820/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:47.426367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863e373-3087-4ab3-b3c6-37963bcdc182 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:47.437748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 797/1617] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:47 2022] POST /identity/v3/projects => generated 363 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:47.439099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f36c22-559f-48d0-abd7-3b9d2d1c714c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.440321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f36c22-559f-48d0-abd7-3b9d2d1c714c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.440321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f36c22-559f-48d0-abd7-3b9d2d1c714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.449106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863e373-3087-4ab3-b3c6-37963bcdc182 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:47.528864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-61f36c22-559f-48d0-abd7-3b9d2d1c714c None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:47.530421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-61f36c22-559f-48d0-abd7-3b9d2d1c714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:47.562316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc66e4-4e03-4b21-9f74-3f5fd16e7755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:47.563107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc66e4-4e03-4b21-9f74-3f5fd16e7755 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.564039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc66e4-4e03-4b21-9f74-3f5fd16e7755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.564386 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc66e4-4e03-4b21-9f74-3f5fd16e7755 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.567820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc66e4-4e03-4b21-9f74-3f5fd16e7755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:47.572862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc66e4-4e03-4b21-9f74-3f5fd16e7755 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:47.633171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 798/1618] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Sep 9 12:17:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:47.634251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f36c22-559f-48d0-abd7-3b9d2d1c714c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:47.690988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 821/1619] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:47 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:47.691989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc66e4-4e03-4b21-9f74-3f5fd16e7755 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:47.701301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f36c22-559f-48d0-abd7-3b9d2d1c714c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:47.765477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0548f-e63f-47d6-9a54-12e48a12b41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:47.766148 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0548f-e63f-47d6-9a54-12e48a12b41f service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.766443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0548f-e63f-47d6-9a54-12e48a12b41f service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.766908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0548f-e63f-47d6-9a54-12e48a12b41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.800766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:47.805413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc66e4-4e03-4b21-9f74-3f5fd16e7755 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:47.820446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a6093-52c6-4561-9695-700621a13c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:47.821223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a6093-52c6-4561-9695-700621a13c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:47.821508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a6093-52c6-4561-9695-700621a13c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:47.821785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a6093-52c6-4561-9695-700621a13c8a admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:47.822428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a6093-52c6-4561-9695-700621a13c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:47.838345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a6093-52c6-4561-9695-700621a13c8a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:47.859341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0548f-e63f-47d6-9a54-12e48a12b41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:47.861576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0548f-e63f-47d6-9a54-12e48a12b41f service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:47.873845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 799/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:47.874858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0548f-e63f-47d6-9a54-12e48a12b41f service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:47.969840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0548f-e63f-47d6-9a54-12e48a12b41f service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:47.981976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 822/1621] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:47 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:47.986658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a6093-52c6-4561-9695-700621a13c8a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:47.999158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c099-cb26-4043-a8a2-6b58908fc0fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.000021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c099-cb26-4043-a8a2-6b58908fc0fa service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.000413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c099-cb26-4043-a8a2-6b58908fc0fa service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.000764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c099-cb26-4043-a8a2-6b58908fc0fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.005178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a6093-52c6-4561-9695-700621a13c8a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:48.018632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c442c-2f8d-4778-9bd3-c0de3422c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.020841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c442c-2f8d-4778-9bd3-c0de3422c773 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.021212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c442c-2f8d-4778-9bd3-c0de3422c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.022271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c442c-2f8d-4778-9bd3-c0de3422c773 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.023036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c442c-2f8d-4778-9bd3-c0de3422c773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.027038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c442c-2f8d-4778-9bd3-c0de3422c773 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.101731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02c099-cb26-4043-a8a2-6b58908fc0fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.103366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02c099-cb26-4043-a8a2-6b58908fc0fa service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.126086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 800/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:48.131406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c099-cb26-4043-a8a2-6b58908fc0fa service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:48.138795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c099-cb26-4043-a8a2-6b58908fc0fa service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:48.144126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1edd49-98b9-4226-83ae-f25c0f2eee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.145414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1edd49-98b9-4226-83ae-f25c0f2eee4b admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.145903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1edd49-98b9-4226-83ae-f25c0f2eee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.146562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1edd49-98b9-4226-83ae-f25c0f2eee4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.147438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1edd49-98b9-4226-83ae-f25c0f2eee4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.149548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1edd49-98b9-4226-83ae-f25c0f2eee4b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.168385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 801/1623] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:48.171646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1edd49-98b9-4226-83ae-f25c0f2eee4b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:48.197362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1edd49-98b9-4226-83ae-f25c0f2eee4b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:48.209442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031faf3-5e98-418f-aaa0-4f42ba4f9b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.210159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031faf3-5e98-418f-aaa0-4f42ba4f9b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.211673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031faf3-5e98-418f-aaa0-4f42ba4f9b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.217152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031faf3-5e98-418f-aaa0-4f42ba4f9b87 admin admin] PATH_INFO: `/v3/projects/347ad41192ff448495f4ff126bb8f25c/users/43c43f568373461ca43b00916fcf8aa1/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.221493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 823/1624] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:47 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:48.223362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c442c-2f8d-4778-9bd3-c0de3422c773 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:48.253661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c442c-2f8d-4778-9bd3-c0de3422c773 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:48.256484 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031faf3-5e98-418f-aaa0-4f42ba4f9b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347ad41192ff448495f4ff126bb8f25c, user_id=43c43f568373461ca43b00916fcf8aa1, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.263139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031faf3-5e98-418f-aaa0-4f42ba4f9b87 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.266743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f1f5f-01d7-4f60-8187-a655d6ffd6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.267573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f1f5f-01d7-4f60-8187-a655d6ffd6bb admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.268157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f1f5f-01d7-4f60-8187-a655d6ffd6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.268617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f1f5f-01d7-4f60-8187-a655d6ffd6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.269532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f1f5f-01d7-4f60-8187-a655d6ffd6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.272399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f1f5f-01d7-4f60-8187-a655d6ffd6bb admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.293012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 824/1625] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:48.298229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f1f5f-01d7-4f60-8187-a655d6ffd6bb admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:48.313811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f1f5f-01d7-4f60-8187-a655d6ffd6bb admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:48.319645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703de59-5d46-4b88-aa9b-103d2956db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.321215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703de59-5d46-4b88-aa9b-103d2956db91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.321966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703de59-5d46-4b88-aa9b-103d2956db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.326158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703de59-5d46-4b88-aa9b-103d2956db91 admin admin] PATH_INFO: `/v3/projects/a10a55bcf9f542aeb8efd48574d80d5f/users/b333f0c3974341d89d017fd7c83f5169/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.344984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703de59-5d46-4b88-aa9b-103d2956db91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10a55bcf9f542aeb8efd48574d80d5f, user_id=b333f0c3974341d89d017fd7c83f5169, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.348567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703de59-5d46-4b88-aa9b-103d2956db91 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.373907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:48.387416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 802/1626] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:48 2022] PUT /identity/v3/projects/347ad41192ff448495f4ff126bb8f25c/users/43c43f568373461ca43b00916fcf8aa1/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:48.393521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031faf3-5e98-418f-aaa0-4f42ba4f9b87 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:48.471012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 825/1627] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:48 2022] PUT /identity/v3/projects/a10a55bcf9f542aeb8efd48574d80d5f/users/b333f0c3974341d89d017fd7c83f5169/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:48.472756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e5d73-70c9-4432-a23c-5efeb153075f None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.473047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e5d73-70c9-4432-a23c-5efeb153075f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.473586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e5d73-70c9-4432-a23c-5efeb153075f None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.480140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 826/1628] 10.222.0.27 () {54 vars in 912 bytes} [Fri Sep 9 12:17:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:17:48.481304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e5d73-70c9-4432-a23c-5efeb153075f None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:48.537990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031faf3-5e98-418f-aaa0-4f42ba4f9b87 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:48.588124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e5d73-70c9-4432-a23c-5efeb153075f None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:48.598068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d87c9-9d3b-4fdc-9ee0-e4d453e8ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.598710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d87c9-9d3b-4fdc-9ee0-e4d453e8ab88 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.598997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d87c9-9d3b-4fdc-9ee0-e4d453e8ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.599273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d87c9-9d3b-4fdc-9ee0-e4d453e8ab88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.603638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d87c9-9d3b-4fdc-9ee0-e4d453e8ab88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.608639 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d87c9-9d3b-4fdc-9ee0-e4d453e8ab88 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.644032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 827/1629] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:48.646066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bfbd-79e7-4f35-8351-bf5b812ea2e0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.647102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bfbd-79e7-4f35-8351-bf5b812ea2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.647389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bfbd-79e7-4f35-8351-bf5b812ea2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.665780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba8882-88e0-433a-8b87-70248ec6bfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.667292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba8882-88e0-433a-8b87-70248ec6bfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.668379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba8882-88e0-433a-8b87-70248ec6bfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.668720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba8882-88e0-433a-8b87-70248ec6bfa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.670084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba8882-88e0-433a-8b87-70248ec6bfa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.675093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba8882-88e0-433a-8b87-70248ec6bfa7 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.699360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-dc59bfbd-79e7-4f35-8351-bf5b812ea2e0 None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:48.704122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 803/1630] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:48.705373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-dc59bfbd-79e7-4f35-8351-bf5b812ea2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:48.708070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba8882-88e0-433a-8b87-70248ec6bfa7 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:48.725378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba8882-88e0-433a-8b87-70248ec6bfa7 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:48.733926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01ec47-d620-4355-98b4-d3521d3983e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.735295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01ec47-d620-4355-98b4-d3521d3983e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.735295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01ec47-d620-4355-98b4-d3521d3983e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.735598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01ec47-d620-4355-98b4-d3521d3983e9 admin admin] PATH_INFO: `/v3/projects/a10a55bcf9f542aeb8efd48574d80d5f/users/b333f0c3974341d89d017fd7c83f5169/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.738083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01ec47-d620-4355-98b4-d3521d3983e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10a55bcf9f542aeb8efd48574d80d5f, user_id=b333f0c3974341d89d017fd7c83f5169, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.742635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01ec47-d620-4355-98b4-d3521d3983e9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.758422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 804/1631] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:48 2022] PUT /identity/v3/projects/a10a55bcf9f542aeb8efd48574d80d5f/users/b333f0c3974341d89d017fd7c83f5169/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:48.761358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01ec47-d620-4355-98b4-d3521d3983e9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:48.801702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:48.830384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:48.854985 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 828/1632] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:48.858102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc98f0f-2d7b-4541-b2e4-e25dde3ac583 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.858501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc98f0f-2d7b-4541-b2e4-e25dde3ac583 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.859022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc98f0f-2d7b-4541-b2e4-e25dde3ac583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.902550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ddc98f0f-2d7b-4541-b2e4-e25dde3ac583 None None] MFA Rules not processed for user `b333f0c3974341d89d017fd7c83f5169`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:48.909928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ddc98f0f-2d7b-4541-b2e4-e25dde3ac583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:48.923996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01ec47-d620-4355-98b4-d3521d3983e9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:48.944078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44a87a-6df7-4230-9b58-1867984bf948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:48.950818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44a87a-6df7-4230-9b58-1867984bf948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:48.950818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44a87a-6df7-4230-9b58-1867984bf948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:48.950818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44a87a-6df7-4230-9b58-1867984bf948 admin admin] PATH_INFO: `/v3/projects/347ad41192ff448495f4ff126bb8f25c/users/43c43f568373461ca43b00916fcf8aa1/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:48.950818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44a87a-6df7-4230-9b58-1867984bf948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347ad41192ff448495f4ff126bb8f25c, user_id=43c43f568373461ca43b00916fcf8aa1, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:48.950818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44a87a-6df7-4230-9b58-1867984bf948 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:48.973286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 805/1633] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:48 2022] PUT /identity/v3/projects/347ad41192ff448495f4ff126bb8f25c/users/43c43f568373461ca43b00916fcf8aa1/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:48.978817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44a87a-6df7-4230-9b58-1867984bf948 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:49.015590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:49.025822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 829/1634] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:49.027162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f6956-d650-4eaf-bc08-3e13f123feba None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:49.027591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f6956-d650-4eaf-bc08-3e13f123feba None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:49.027734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f6956-d650-4eaf-bc08-3e13f123feba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:49.089529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b40f6956-d650-4eaf-bc08-3e13f123feba None None] MFA Rules not processed for user `43c43f568373461ca43b00916fcf8aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:49.091974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b40f6956-d650-4eaf-bc08-3e13f123feba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:49.102949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44a87a-6df7-4230-9b58-1867984bf948 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:49.111724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5361cf-5f54-4674-86eb-8e08758b036d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:49.112442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5361cf-5f54-4674-86eb-8e08758b036d service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:49.112821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5361cf-5f54-4674-86eb-8e08758b036d service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:49.113100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5361cf-5f54-4674-86eb-8e08758b036d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:49.258305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5361cf-5f54-4674-86eb-8e08758b036d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:49.260121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5361cf-5f54-4674-86eb-8e08758b036d service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:49.277514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 806/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:49.278782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5361cf-5f54-4674-86eb-8e08758b036d service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:49.287763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 830/1636] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:49.294124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5361cf-5f54-4674-86eb-8e08758b036d service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:49.308836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75e2a6-90a1-4899-86fb-fba9a1c70e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:49.560265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75e2a6-90a1-4899-86fb-fba9a1c70e1b service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:49.560265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75e2a6-90a1-4899-86fb-fba9a1c70e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:49.560265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75e2a6-90a1-4899-86fb-fba9a1c70e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:49.560265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75e2a6-90a1-4899-86fb-fba9a1c70e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:49.560265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75e2a6-90a1-4899-86fb-fba9a1c70e1b service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:49.560265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 807/1637] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:49.706754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f6956-d650-4eaf-bc08-3e13f123feba None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:49.717950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f6956-d650-4eaf-bc08-3e13f123feba None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:49.723321 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cafb1-7fcb-4690-b667-24eb172eca11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:49.723983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cafb1-7fcb-4690-b667-24eb172eca11 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:49.724931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cafb1-7fcb-4690-b667-24eb172eca11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:49.725669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cafb1-7fcb-4690-b667-24eb172eca11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:49.736527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cafb1-7fcb-4690-b667-24eb172eca11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:49.737963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cafb1-7fcb-4690-b667-24eb172eca11 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:49.750142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 831/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:50.046521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:50.397699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f6a81-a9a9-4f7d-aac5-0ded9ae24198 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:50.397910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f6a81-a9a9-4f7d-aac5-0ded9ae24198 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:50.399124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f6a81-a9a9-4f7d-aac5-0ded9ae24198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:50.438050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-c46f6a81-a9a9-4f7d-aac5-0ded9ae24198 None None] MFA Rules not processed for user `f67e1f2019704894be94e6ff6f81be2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:50.439190 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c46f6a81-a9a9-4f7d-aac5-0ded9ae24198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:50.455498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cafb1-7fcb-4690-b667-24eb172eca11 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:50.466326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cafb1-7fcb-4690-b667-24eb172eca11 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:50.471380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e35099-7ca1-4d44-81b2-633dee75f709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:50.472037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e35099-7ca1-4d44-81b2-633dee75f709 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:50.472364 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e35099-7ca1-4d44-81b2-633dee75f709 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:50.472644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e35099-7ca1-4d44-81b2-633dee75f709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:50.539982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:50.579685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e35099-7ca1-4d44-81b2-633dee75f709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:50.581298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e35099-7ca1-4d44-81b2-633dee75f709 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:50.607300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 808/1639] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:50.610492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 832/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:50.621929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f6a81-a9a9-4f7d-aac5-0ded9ae24198 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:50.778261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f6a81-a9a9-4f7d-aac5-0ded9ae24198 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:50.790683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523c380-5db7-4711-a569-47b019ac3980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:50.791724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523c380-5db7-4711-a569-47b019ac3980 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:50.792194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523c380-5db7-4711-a569-47b019ac3980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:50.792659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523c380-5db7-4711-a569-47b019ac3980 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:50.793586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523c380-5db7-4711-a569-47b019ac3980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:50.803052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523c380-5db7-4711-a569-47b019ac3980 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:50.949168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 809/1641] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:17:50 2022] POST /identity/v3/projects => generated 403 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:50.953048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e35099-7ca1-4d44-81b2-633dee75f709 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:50.975449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e35099-7ca1-4d44-81b2-633dee75f709 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:51.165017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f2cf5-b5a1-4f5e-b28d-f7a051d0f0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:51.165617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f2cf5-b5a1-4f5e-b28d-f7a051d0f0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.165902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f2cf5-b5a1-4f5e-b28d-f7a051d0f0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.166182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f2cf5-b5a1-4f5e-b28d-f7a051d0f0dd admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.170026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f2cf5-b5a1-4f5e-b28d-f7a051d0f0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:51.179043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f2cf5-b5a1-4f5e-b28d-f7a051d0f0dd admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:51.319176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523c380-5db7-4711-a569-47b019ac3980 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:51.320651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 833/1642] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:17:50 2022] POST /identity/v3/users => generated 308 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:17:51.334305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523c380-5db7-4711-a569-47b019ac3980 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:51.349048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e0ecf-3413-49b7-b728-c5880261be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:51.349790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e0ecf-3413-49b7-b728-c5880261be95 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.350034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e0ecf-3413-49b7-b728-c5880261be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.350308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e0ecf-3413-49b7-b728-c5880261be95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.351091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e0ecf-3413-49b7-b728-c5880261be95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:51.360297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e0ecf-3413-49b7-b728-c5880261be95 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:51.363824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c77bf7-ee7c-4c47-a20b-1766436b70a6 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.363824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c77bf7-ee7c-4c47-a20b-1766436b70a6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.363824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c77bf7-ee7c-4c47-a20b-1766436b70a6 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.364543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 834/1643] 10.222.0.27 () {54 vars in 962 bytes} [Fri Sep 9 12:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 12:17:51.374593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a075087-42f2-4081-826d-e17d423da87c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.374880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a075087-42f2-4081-826d-e17d423da87c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.375144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a075087-42f2-4081-826d-e17d423da87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.387331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 810/1644] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:51.394445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e0ecf-3413-49b7-b728-c5880261be95 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:51.403314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e0ecf-3413-49b7-b728-c5880261be95 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:51.412915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:51.421061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32dac1-b57a-4d27-9b47-48c476a562ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:51.421744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32dac1-b57a-4d27-9b47-48c476a562ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.435368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32dac1-b57a-4d27-9b47-48c476a562ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.435368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32dac1-b57a-4d27-9b47-48c476a562ba admin admin] PATH_INFO: `/v3/projects/2e62ff2cf3e749ed9b9c1d441cb3e12b/users/e5f400e4c5144293b61c281d28074a24/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.435782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-1a075087-42f2-4081-826d-e17d423da87c None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:51.435782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1a075087-42f2-4081-826d-e17d423da87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:51.470990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32dac1-b57a-4d27-9b47-48c476a562ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e62ff2cf3e749ed9b9c1d441cb3e12b, user_id=e5f400e4c5144293b61c281d28074a24, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:51.474028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32dac1-b57a-4d27-9b47-48c476a562ba admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:51.551361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 835/1645] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Sep 9 12:17:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 09 12:17:51.558988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059d917-3566-46ed-965a-bedb47819f8d None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.572320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059d917-3566-46ed-965a-bedb47819f8d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.572841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059d917-3566-46ed-965a-bedb47819f8d None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.578148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 836/1646] 10.222.0.27 () {54 vars in 912 bytes} [Fri Sep 9 12:17:51 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:17:51.584695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f7e53-f9ba-477b-a4df-c1e5fe0c59d4 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.584991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f7e53-f9ba-477b-a4df-c1e5fe0c59d4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.585274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f7e53-f9ba-477b-a4df-c1e5fe0c59d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.600550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 811/1647] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:51 2022] PUT /identity/v3/projects/2e62ff2cf3e749ed9b9c1d441cb3e12b/users/e5f400e4c5144293b61c281d28074a24/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:51.601743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32dac1-b57a-4d27-9b47-48c476a562ba admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:51.693364 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5a7f7e53-f9ba-477b-a4df-c1e5fe0c59d4 None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:51.696861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5a7f7e53-f9ba-477b-a4df-c1e5fe0c59d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:51.791270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32dac1-b57a-4d27-9b47-48c476a562ba admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:51.801590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a348a1-c35d-4be3-8187-d3d0df217a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:51.802227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a348a1-c35d-4be3-8187-d3d0df217a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.802543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a348a1-c35d-4be3-8187-d3d0df217a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.802817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a348a1-c35d-4be3-8187-d3d0df217a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.803478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a348a1-c35d-4be3-8187-d3d0df217a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:51.805924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a348a1-c35d-4be3-8187-d3d0df217a32 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:51.822280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:51.833082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 812/1648] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:17:51.834705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a348a1-c35d-4be3-8187-d3d0df217a32 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:51.852435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 837/1649] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:17:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:51.852435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f7e53-f9ba-477b-a4df-c1e5fe0c59d4 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:51.852746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a348a1-c35d-4be3-8187-d3d0df217a32 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:51.862326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:51.863205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.863384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.863845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] PATH_INFO: `/v3/users/16e25d8988c7443ebb75ce45dba61352` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.867566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f7e53-f9ba-477b-a4df-c1e5fe0c59d4 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:51.868665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e25d8988c7443ebb75ce45dba61352)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:51.869773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: WARNING py.warnings [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:17:51.869773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: warnings.warn(msg) Sep 09 12:17:51.869773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: Sep 09 12:17:51.872746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:51.879661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565273e4-e2b4-4369-a211-b361607d5811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:51.880431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565273e4-e2b4-4369-a211-b361607d5811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:51.880746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565273e4-e2b4-4369-a211-b361607d5811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:51.881024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565273e4-e2b4-4369-a211-b361607d5811 admin admin] PATH_INFO: `/v3/projects/2e62ff2cf3e749ed9b9c1d441cb3e12b/users/e5f400e4c5144293b61c281d28074a24/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:51.883436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565273e4-e2b4-4369-a211-b361607d5811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e62ff2cf3e749ed9b9c1d441cb3e12b, user_id=e5f400e4c5144293b61c281d28074a24, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:51.886818 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565273e4-e2b4-4369-a211-b361607d5811 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:51.901379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 838/1650] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:17:51 2022] PUT /identity/v3/projects/2e62ff2cf3e749ed9b9c1d441cb3e12b/users/e5f400e4c5144293b61c281d28074a24/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:51.906941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565273e4-e2b4-4369-a211-b361607d5811 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:51.993084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565273e4-e2b4-4369-a211-b361607d5811 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:51.998636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074969e-373e-4ca3-8983-08af6c2ba0c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:51.999349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074969e-373e-4ca3-8983-08af6c2ba0c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:52.001814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074969e-373e-4ca3-8983-08af6c2ba0c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:52.001814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074969e-373e-4ca3-8983-08af6c2ba0c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:52.147111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074969e-373e-4ca3-8983-08af6c2ba0c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:52.150447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074969e-373e-4ca3-8983-08af6c2ba0c4 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:52.167037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e25d8988c7443ebb75ce45dba61352'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:52.190535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 839/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:52.281404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e25d8988c7443ebb75ce45dba61352'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:52.329475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e25d8988c7443ebb75ce45dba61352'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:52.333499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e25d8988c7443ebb75ce45dba61352'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:52.366854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e25d8988c7443ebb75ce45dba61352'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:52.393653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 813/1652] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:17:51 2022] DELETE /identity/v3/users/16e25d8988c7443ebb75ce45dba61352 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:52.399275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44ca0-702e-43a5-9d94-4f478e1f0bbf None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:52.399908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44ca0-702e-43a5-9d94-4f478e1f0bbf None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:52.400380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44ca0-702e-43a5-9d94-4f478e1f0bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:52.461332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-83b44ca0-702e-43a5-9d94-4f478e1f0bbf None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:52.462847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-83b44ca0-702e-43a5-9d94-4f478e1f0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:52.635070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 840/1653] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:52.689884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:52.691437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:52.755216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:52.837804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc576e-3b89-48d5-a4e8-14fc50aa1000 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:52.848368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fb8a2-6c8f-484a-9914-0ae4ada8e819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:52.849108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fb8a2-6c8f-484a-9914-0ae4ada8e819 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:52.851198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fb8a2-6c8f-484a-9914-0ae4ada8e819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:52.851482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fb8a2-6c8f-484a-9914-0ae4ada8e819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:52.876362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fb8a2-6c8f-484a-9914-0ae4ada8e819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:52.877832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fb8a2-6c8f-484a-9914-0ae4ada8e819 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:52.908476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 814/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:56.258516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b44ca0-702e-43a5-9d94-4f478e1f0bbf None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:56.262642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-83b44ca0-702e-43a5-9d94-4f478e1f0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:56.286181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b44ca0-702e-43a5-9d94-4f478e1f0bbf None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:56.302755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:56.303426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:56.308911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:56.309305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] PATH_INFO: `/v3/projects/02a895cb05f340a7ba92b3da268c0d48` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:56.312402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a895cb05f340a7ba92b3da268c0d48)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:56.313452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: WARNING py.warnings [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 12:17:56.313452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: warnings.warn(msg) Sep 09 12:17:56.313452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: Sep 09 12:17:56.314666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:56.385022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:56.564945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a895cb05f340a7ba92b3da268c0d48', 'request_id': 'req-1ce02622-8485-46f9-abcb-9339d47ae680'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:56.652802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a895cb05f340a7ba92b3da268c0d48', 'request_id': 'req-1ce02622-8485-46f9-abcb-9339d47ae680'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:56.679308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a895cb05f340a7ba92b3da268c0d48', 'request_id': 'req-1ce02622-8485-46f9-abcb-9339d47ae680'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:56.702509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] The token cache is being invalidate because project 02a895cb05f340a7ba92b3da268c0d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:17:56.702807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:56.703689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1ce02622-8485-46f9-abcb-9339d47ae680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:56.705263 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 841/1655] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:17:56 2022] DELETE /identity/v3/projects/02a895cb05f340a7ba92b3da268c0d48 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:56.709690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fb8a2-6c8f-484a-9914-0ae4ada8e819 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:56.727823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fb8a2-6c8f-484a-9914-0ae4ada8e819 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:56.878153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:56.880750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:56.881065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:56.881563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] PATH_INFO: `/v3/users/b333f0c3974341d89d017fd7c83f5169` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:56.887200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b333f0c3974341d89d017fd7c83f5169)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:56.891103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:57.159084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b333f0c3974341d89d017fd7c83f5169'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:57.268794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b333f0c3974341d89d017fd7c83f5169'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:57.296257 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b333f0c3974341d89d017fd7c83f5169'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:57.297458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b333f0c3974341d89d017fd7c83f5169'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:57.320441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b333f0c3974341d89d017fd7c83f5169'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:57.338056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 815/1656] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:17:56 2022] DELETE /identity/v3/users/b333f0c3974341d89d017fd7c83f5169 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:57.702272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1996ab-136e-4c61-829b-8dc655edcc6a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:57.702658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1996ab-136e-4c61-829b-8dc655edcc6a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:57.702831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1996ab-136e-4c61-829b-8dc655edcc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:57.762456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-bc1996ab-136e-4c61-829b-8dc655edcc6a None None] MFA Rules not processed for user `e5f400e4c5144293b61c281d28074a24`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:57.763908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bc1996ab-136e-4c61-829b-8dc655edcc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:57.946140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 842/1657] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:58.221582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:58.221582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:58.329250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:58.355518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8706d2-031e-4d5c-aec5-0934c3cee0eb admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:58.362833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:58.363554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:58.363891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:58.364155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] PATH_INFO: `/v3/users/9aaf5614887b4f4f882da8d142f130d3` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:58.366911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aaf5614887b4f4f882da8d142f130d3)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:58.370230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:58.689630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aaf5614887b4f4f882da8d142f130d3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:58.801077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aaf5614887b4f4f882da8d142f130d3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:58.832814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aaf5614887b4f4f882da8d142f130d3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:58.834464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aaf5614887b4f4f882da8d142f130d3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:58.857209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aaf5614887b4f4f882da8d142f130d3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:58.886426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 816/1658] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:17:58 2022] DELETE /identity/v3/users/9aaf5614887b4f4f882da8d142f130d3 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:58.891335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676c566-c462-452e-b409-ba31ddbdd21e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:58.891866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676c566-c462-452e-b409-ba31ddbdd21e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:58.891941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676c566-c462-452e-b409-ba31ddbdd21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:58.941314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9676c566-c462-452e-b409-ba31ddbdd21e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:58.942579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9676c566-c462-452e-b409-ba31ddbdd21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:59.096674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 843/1659] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:59.125353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:59.128048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:59.222189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293a375-5e8e-4b88-b92d-085826ff73ca admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:59.228809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f40c74-616c-44d2-a2b0-fe6b5aaf16f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:59.229952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f40c74-616c-44d2-a2b0-fe6b5aaf16f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:59.230655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f40c74-616c-44d2-a2b0-fe6b5aaf16f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:59.231273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f40c74-616c-44d2-a2b0-fe6b5aaf16f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:59.247535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f40c74-616c-44d2-a2b0-fe6b5aaf16f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:59.249566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f40c74-616c-44d2-a2b0-fe6b5aaf16f5 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:59.275690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 817/1660] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:17:59.323222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676c566-c462-452e-b409-ba31ddbdd21e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:59.325116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9676c566-c462-452e-b409-ba31ddbdd21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:59.356254 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676c566-c462-452e-b409-ba31ddbdd21e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:17:59.361789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:17:59.362461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:59.362743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:59.363020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] PATH_INFO: `/v3/projects/a10a55bcf9f542aeb8efd48574d80d5f` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:59.364723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10a55bcf9f542aeb8efd48574d80d5f)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:17:59.366742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:17:59.441757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:59.563945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10a55bcf9f542aeb8efd48574d80d5f', 'request_id': 'req-e32833bc-116b-4e46-ab70-2316df3a87d2'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:59.632329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10a55bcf9f542aeb8efd48574d80d5f', 'request_id': 'req-e32833bc-116b-4e46-ab70-2316df3a87d2'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:59.648830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10a55bcf9f542aeb8efd48574d80d5f', 'request_id': 'req-e32833bc-116b-4e46-ab70-2316df3a87d2'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:59.665497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] The token cache is being invalidate because project a10a55bcf9f542aeb8efd48574d80d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:17:59.666060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:59.666906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-e32833bc-116b-4e46-ab70-2316df3a87d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:17:59.670731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 844/1661] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:17:59 2022] DELETE /identity/v3/projects/a10a55bcf9f542aeb8efd48574d80d5f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:17:59.674069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64f90-3ff0-4b21-a8b3-bb84676fc812 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:59.674366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64f90-3ff0-4b21-a8b3-bb84676fc812 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:59.674646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64f90-3ff0-4b21-a8b3-bb84676fc812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:59.681559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913de17-c14a-465c-8369-d416213e405c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:17:59.682371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913de17-c14a-465c-8369-d416213e405c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:17:59.682878 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913de17-c14a-465c-8369-d416213e405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:17:59.746923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-27d64f90-3ff0-4b21-a8b3-bb84676fc812 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:59.749696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-0913de17-c14a-465c-8369-d416213e405c None None] MFA Rules not processed for user `504c97036895408b9e04deb0792d5576`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:17:59.751252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0913de17-c14a-465c-8369-d416213e405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:59.753925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-27d64f90-3ff0-4b21-a8b3-bb84676fc812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:17:59.905442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 845/1662] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:17:59.920977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913de17-c14a-465c-8369-d416213e405c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:17:59.928126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0913de17-c14a-465c-8369-d416213e405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:00.027105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 818/1663] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:00.032291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d59f-a889-434d-b2b7-e42605b14019 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:00.032291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d59f-a889-434d-b2b7-e42605b14019 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:00.032291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d59f-a889-434d-b2b7-e42605b14019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:00.090619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-7649d59f-a889-434d-b2b7-e42605b14019 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:00.094003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7649d59f-a889-434d-b2b7-e42605b14019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:00.132662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 819/1664] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:00.136957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d59f-a889-434d-b2b7-e42605b14019 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:00.155292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913de17-c14a-465c-8369-d416213e405c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:00.158759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d59f-a889-434d-b2b7-e42605b14019 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:00.166011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9d351-248d-4757-87a5-c99b0b241759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:00.167781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d351-248d-4757-87a5-c99b0b241759 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:00.168070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d351-248d-4757-87a5-c99b0b241759 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:00.168347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d351-248d-4757-87a5-c99b0b241759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:00.179793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc9130-5168-4d84-8360-0b4da7a75360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:00.181333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9130-5168-4d84-8360-0b4da7a75360 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:00.181957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9130-5168-4d84-8360-0b4da7a75360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:00.182406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9130-5168-4d84-8360-0b4da7a75360 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:00.189534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc9130-5168-4d84-8360-0b4da7a75360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:00.203187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc9130-5168-4d84-8360-0b4da7a75360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:00.203187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc9130-5168-4d84-8360-0b4da7a75360 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:00.203638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9d351-248d-4757-87a5-c99b0b241759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:00.203638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9d351-248d-4757-87a5-c99b0b241759 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:00.226202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 820/1665] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:00.231952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc9130-5168-4d84-8360-0b4da7a75360 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:00.232674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 846/1666] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:17:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:00.257639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc9130-5168-4d84-8360-0b4da7a75360 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:00.273294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e5696-7891-46ae-aa82-7246dcd3dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:00.275366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e5696-7891-46ae-aa82-7246dcd3dd46 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:00.277152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e5696-7891-46ae-aa82-7246dcd3dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:00.277624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e5696-7891-46ae-aa82-7246dcd3dd46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:00.278491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e5696-7891-46ae-aa82-7246dcd3dd46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:00.283766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e5696-7891-46ae-aa82-7246dcd3dd46 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:00.416393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 821/1667] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:00 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:00.421418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9d351-248d-4757-87a5-c99b0b241759 service nova] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:00.450689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9d351-248d-4757-87a5-c99b0b241759 service nova] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:00.541235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:00.632372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26ea7e-8793-4290-a960-f475c426ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:00.632964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26ea7e-8793-4290-a960-f475c426ead1 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:00.636455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26ea7e-8793-4290-a960-f475c426ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:00.636817 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26ea7e-8793-4290-a960-f475c426ead1 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:00.637520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26ea7e-8793-4290-a960-f475c426ead1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:00.646700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26ea7e-8793-4290-a960-f475c426ead1 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:00.823119 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 847/1668] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:00 2022] POST /identity/v3/users => generated 283 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:00.824700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e5696-7891-46ae-aa82-7246dcd3dd46 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:00.842804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e5696-7891-46ae-aa82-7246dcd3dd46 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:00.856593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874da5-1775-4841-8135-88f1e1780ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:00.863516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874da5-1775-4841-8135-88f1e1780ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:00.863516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874da5-1775-4841-8135-88f1e1780ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:00.863516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874da5-1775-4841-8135-88f1e1780ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:00.863516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df874da5-1775-4841-8135-88f1e1780ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:00.866136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df874da5-1775-4841-8135-88f1e1780ed5 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:00.903736 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 822/1669] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:00.906860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26ea7e-8793-4290-a960-f475c426ead1 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:00.925540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26ea7e-8793-4290-a960-f475c426ead1 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:00.937602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c2d39-4fa6-4a14-8778-776cdb5607b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:00.938246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2d39-4fa6-4a14-8778-776cdb5607b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:00.938532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2d39-4fa6-4a14-8778-776cdb5607b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:00.938816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2d39-4fa6-4a14-8778-776cdb5607b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:00.944183 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c2d39-4fa6-4a14-8778-776cdb5607b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:00.947672 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c2d39-4fa6-4a14-8778-776cdb5607b5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:00.955939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874da5-1775-4841-8135-88f1e1780ed5 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:00.959344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-df874da5-1775-4841-8135-88f1e1780ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:00.992436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 848/1670] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:00.992650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874da5-1775-4841-8135-88f1e1780ed5 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:00.997632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c2d39-4fa6-4a14-8778-776cdb5607b5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:01.009083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:01.009083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:01.009083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:01.009348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] PATH_INFO: `/v3/projects/3b175fa3bc0449738bc0132b165b7d5c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:01.013105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b175fa3bc0449738bc0132b165b7d5c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:01.019481 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:01.036118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c2d39-4fa6-4a14-8778-776cdb5607b5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:01.051643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653d227-e699-4c65-80d8-318201bbfb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:01.052537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d227-e699-4c65-80d8-318201bbfb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:01.053073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d227-e699-4c65-80d8-318201bbfb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:01.053603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d227-e699-4c65-80d8-318201bbfb8b admin admin] PATH_INFO: `/v3/projects/64e8567321d7448e938c87d86eb64b5a/users/b65071c850964377a767555b40fb6b88/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:01.128976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653d227-e699-4c65-80d8-318201bbfb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e8567321d7448e938c87d86eb64b5a, user_id=b65071c850964377a767555b40fb6b88, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:01.152115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653d227-e699-4c65-80d8-318201bbfb8b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:01.278441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 849/1671] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:00 2022] PUT /identity/v3/projects/64e8567321d7448e938c87d86eb64b5a/users/b65071c850964377a767555b40fb6b88/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:01.280287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2f59-7350-4ae6-a0a5-0f56b4cb0334 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:01.281027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2f59-7350-4ae6-a0a5-0f56b4cb0334 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:01.282292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2f59-7350-4ae6-a0a5-0f56b4cb0334 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:01.287752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 850/1672] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:18:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:18:01.289295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453421b-0d86-4f2f-a764-a287a90a78a5 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:01.290020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453421b-0d86-4f2f-a764-a287a90a78a5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:01.290502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453421b-0d86-4f2f-a764-a287a90a78a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:01.312901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b175fa3bc0449738bc0132b165b7d5c', 'request_id': 'req-a5355e32-14c7-4a6a-aeaf-242a252faefb'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:01.335309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b175fa3bc0449738bc0132b165b7d5c', 'request_id': 'req-a5355e32-14c7-4a6a-aeaf-242a252faefb'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:01.410129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f453421b-0d86-4f2f-a764-a287a90a78a5 None None] MFA Rules not processed for user `b65071c850964377a767555b40fb6b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:01.413244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f453421b-0d86-4f2f-a764-a287a90a78a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:01.448313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b175fa3bc0449738bc0132b165b7d5c', 'request_id': 'req-a5355e32-14c7-4a6a-aeaf-242a252faefb'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:01.474756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] The token cache is being invalidate because project 3b175fa3bc0449738bc0132b165b7d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:01.475072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:01.477108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a5355e32-14c7-4a6a-aeaf-242a252faefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:01.486555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 823/1673] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:00 2022] DELETE /identity/v3/projects/3b175fa3bc0449738bc0132b165b7d5c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:01.491155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c172ea-2569-453c-a247-768e4699a01d None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:01.494942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c172ea-2569-453c-a247-768e4699a01d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:01.495839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c172ea-2569-453c-a247-768e4699a01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:01.546257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:01.620247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-82c172ea-2569-453c-a247-768e4699a01d None None] MFA Rules not processed for user `03a4b508dd7048df83f7beeacfe9c085`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:01.625846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-82c172ea-2569-453c-a247-768e4699a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:01.637628 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 851/1674] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:01.640518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3c8bc-0dc8-43fa-b24b-b6e8b4041f89 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:01.644378 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3c8bc-0dc8-43fa-b24b-b6e8b4041f89 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:01.644708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3c8bc-0dc8-43fa-b24b-b6e8b4041f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:01.749381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-54b3c8bc-0dc8-43fa-b24b-b6e8b4041f89 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:01.752104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-54b3c8bc-0dc8-43fa-b24b-b6e8b4041f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:01.806438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 824/1675] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:18:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:01.808032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c172ea-2569-453c-a247-768e4699a01d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:01.811522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-82c172ea-2569-453c-a247-768e4699a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:01.873339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 852/1676] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:01.875144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedbbeb-c279-4906-8094-71f194570a62 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:01.875441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedbbeb-c279-4906-8094-71f194570a62 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:01.875744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedbbeb-c279-4906-8094-71f194570a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:01.960882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-fdedbbeb-c279-4906-8094-71f194570a62 None None] MFA Rules not processed for user `be0f76350dc148c6b51705693a1902c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:01.963217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fdedbbeb-c279-4906-8094-71f194570a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:02.024875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c172ea-2569-453c-a247-768e4699a01d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:02.031401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d90581-1464-4e26-85fd-59ebf8087d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:02.032274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d90581-1464-4e26-85fd-59ebf8087d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:02.032661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d90581-1464-4e26-85fd-59ebf8087d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:02.033032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d90581-1464-4e26-85fd-59ebf8087d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:02.034052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d90581-1464-4e26-85fd-59ebf8087d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:02.037454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d90581-1464-4e26-85fd-59ebf8087d0d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:02.135675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 825/1677] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:01 2022] POST /identity/v3/projects => generated 365 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:02.137220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fbbd0-028e-402f-80d0-ea36c71353d5 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:02.138083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fbbd0-028e-402f-80d0-ea36c71353d5 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:02.139591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fbbd0-028e-402f-80d0-ea36c71353d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:02.151583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 853/1678] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:02.152603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedbbeb-c279-4906-8094-71f194570a62 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:02.154301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fdedbbeb-c279-4906-8094-71f194570a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:02.171919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedbbeb-c279-4906-8094-71f194570a62 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:02.203799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-402fbbd0-028e-402f-80d0-ea36c71353d5 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:02.207775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-402fbbd0-028e-402f-80d0-ea36c71353d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:02.325594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f6bf-5e58-404d-900c-157427c18fec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:02.331758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f6bf-5e58-404d-900c-157427c18fec service placement] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:02.331758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f6bf-5e58-404d-900c-157427c18fec service placement] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:02.331758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f6bf-5e58-404d-900c-157427c18fec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:02.353922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576f6bf-5e58-404d-900c-157427c18fec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:02.356368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576f6bf-5e58-404d-900c-157427c18fec service placement] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:02.400466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 826/1679] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:02.401981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fbbd0-028e-402f-80d0-ea36c71353d5 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:02.408486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 854/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:02.409361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f6bf-5e58-404d-900c-157427c18fec service placement] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:02.421560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d576f6bf-5e58-404d-900c-157427c18fec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:02.430584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fbbd0-028e-402f-80d0-ea36c71353d5 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:02.438153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d3472-fcc3-4251-80b6-c404c42900b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:02.440053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d3472-fcc3-4251-80b6-c404c42900b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:02.440879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d3472-fcc3-4251-80b6-c404c42900b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:02.441662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d3472-fcc3-4251-80b6-c404c42900b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:02.443359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d3472-fcc3-4251-80b6-c404c42900b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:02.446133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d3472-fcc3-4251-80b6-c404c42900b0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:02.566654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:02.644559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f6bf-5e58-404d-900c-157427c18fec service placement] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:02.654149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce7fe6-acf6-4eff-b82f-9fab3a2051f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:02.655046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce7fe6-acf6-4eff-b82f-9fab3a2051f3 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:02.655336 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce7fe6-acf6-4eff-b82f-9fab3a2051f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:02.655641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce7fe6-acf6-4eff-b82f-9fab3a2051f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:02.674297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 827/1681] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:02 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:02.675199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d3472-fcc3-4251-80b6-c404c42900b0 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:02.702107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d3472-fcc3-4251-80b6-c404c42900b0 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:02.717467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20e83a-c153-4ea2-8d14-4b89a8d5c56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:02.718102 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20e83a-c153-4ea2-8d14-4b89a8d5c56a admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:02.718634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20e83a-c153-4ea2-8d14-4b89a8d5c56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:02.718916 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20e83a-c153-4ea2-8d14-4b89a8d5c56a admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:02.719732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20e83a-c153-4ea2-8d14-4b89a8d5c56a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:02.719931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20e83a-c153-4ea2-8d14-4b89a8d5c56a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:02.721563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20e83a-c153-4ea2-8d14-4b89a8d5c56a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:02.752880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 828/1682] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:02.753049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20e83a-c153-4ea2-8d14-4b89a8d5c56a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:02.779764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20e83a-c153-4ea2-8d14-4b89a8d5c56a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:02.788508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce7fe6-acf6-4eff-b82f-9fab3a2051f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:02.790358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce7fe6-acf6-4eff-b82f-9fab3a2051f3 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:02.809684 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 855/1683] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:02.810691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce7fe6-acf6-4eff-b82f-9fab3a2051f3 service nova] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:02.819769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e328ff-9545-4aed-a5db-a7c8d357c1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:02.820402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e328ff-9545-4aed-a5db-a7c8d357c1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:02.822787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e328ff-9545-4aed-a5db-a7c8d357c1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:02.823253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e328ff-9545-4aed-a5db-a7c8d357c1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:02.824023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e328ff-9545-4aed-a5db-a7c8d357c1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:02.832944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce7fe6-acf6-4eff-b82f-9fab3a2051f3 service nova] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:02.836451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e328ff-9545-4aed-a5db-a7c8d357c1ae admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:02.838872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca30be1-cebe-4c44-9481-94df2b895e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:02.839793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca30be1-cebe-4c44-9481-94df2b895e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:02.840147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca30be1-cebe-4c44-9481-94df2b895e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:02.840425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca30be1-cebe-4c44-9481-94df2b895e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:02.841322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca30be1-cebe-4c44-9481-94df2b895e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:02.843734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca30be1-cebe-4c44-9481-94df2b895e95 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:02.867961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 829/1684] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:02.868904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e328ff-9545-4aed-a5db-a7c8d357c1ae admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:02.908140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e328ff-9545-4aed-a5db-a7c8d357c1ae admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:02.920364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c743a6-ee04-403e-9123-8810ab9297da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:02.922733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c743a6-ee04-403e-9123-8810ab9297da admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:02.923517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c743a6-ee04-403e-9123-8810ab9297da admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:02.923997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c743a6-ee04-403e-9123-8810ab9297da admin admin] PATH_INFO: `/v3/projects/44f2715d947a4154b4c75998486138fe/users/986caccdb7dd430cbe0d77b845280330/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:02.963109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c743a6-ee04-403e-9123-8810ab9297da admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f2715d947a4154b4c75998486138fe, user_id=986caccdb7dd430cbe0d77b845280330, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:02.967038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c743a6-ee04-403e-9123-8810ab9297da admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:03.041264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 856/1685] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:02 2022] POST /identity/v3/projects => generated 365 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:03.042677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca30be1-cebe-4c44-9481-94df2b895e95 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:03.062436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8ca30be1-cebe-4c44-9481-94df2b895e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:03.095016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 830/1686] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:02 2022] PUT /identity/v3/projects/44f2715d947a4154b4c75998486138fe/users/986caccdb7dd430cbe0d77b845280330/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:03.100150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c743a6-ee04-403e-9123-8810ab9297da admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:03.279640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca30be1-cebe-4c44-9481-94df2b895e95 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:03.295668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:03.300427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:03.300776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:03.301062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] PATH_INFO: `/v3/users/928736b5b6c54982a7d5de64ce546c38` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:03.305947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] RBAC: Authorizing `identity:delete_user(user_id=928736b5b6c54982a7d5de64ce546c38)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:03.309750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:03.310594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c743a6-ee04-403e-9123-8810ab9297da admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:03.323950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd685da2-74c2-4326-a23b-01392d49543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:03.324616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd685da2-74c2-4326-a23b-01392d49543b admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:03.324951 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd685da2-74c2-4326-a23b-01392d49543b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:03.325171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd685da2-74c2-4326-a23b-01392d49543b admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:03.341396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd685da2-74c2-4326-a23b-01392d49543b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:03.344801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd685da2-74c2-4326-a23b-01392d49543b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:03.401157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:03.575685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 831/1687] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:03 2022] POST /identity/v3/users => generated 283 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:03.576416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd685da2-74c2-4326-a23b-01392d49543b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:03.603382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd685da2-74c2-4326-a23b-01392d49543b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:03.615839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc7b12-ab8c-4acb-bbd3-f4556b64f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:03.617443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc7b12-ab8c-4acb-bbd3-f4556b64f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:03.617806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc7b12-ab8c-4acb-bbd3-f4556b64f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:03.617924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928736b5b6c54982a7d5de64ce546c38'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:03.618040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc7b12-ab8c-4acb-bbd3-f4556b64f2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:03.618512 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928736b5b6c54982a7d5de64ce546c38'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:03.621116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc7b12-ab8c-4acb-bbd3-f4556b64f2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:03.624682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc7b12-ab8c-4acb-bbd3-f4556b64f2c3 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:03.653799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 832/1688] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:03.656464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc7b12-ab8c-4acb-bbd3-f4556b64f2c3 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:03.680131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc7b12-ab8c-4acb-bbd3-f4556b64f2c3 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:03.692524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68043-828d-4664-9a67-85c614d35d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:03.696615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68043-828d-4664-9a67-85c614d35d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:03.697205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68043-828d-4664-9a67-85c614d35d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:03.698055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68043-828d-4664-9a67-85c614d35d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:03.700121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba68043-828d-4664-9a67-85c614d35d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:03.705222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba68043-828d-4664-9a67-85c614d35d18 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:03.727190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928736b5b6c54982a7d5de64ce546c38'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:03.727883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928736b5b6c54982a7d5de64ce546c38'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:03.749361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928736b5b6c54982a7d5de64ce546c38'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:03.771809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 833/1689] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:03.771809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68043-828d-4664-9a67-85c614d35d18 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:03.777350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5ba68043-828d-4664-9a67-85c614d35d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:03.805923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68043-828d-4664-9a67-85c614d35d18 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:03.809763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 857/1690] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:03 2022] DELETE /identity/v3/users/928736b5b6c54982a7d5de64ce546c38 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:03.810833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:03.813716 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:03.949210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9c173-17b3-4382-a91b-189373a48f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:03.950019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c173-17b3-4382-a91b-189373a48f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:03.951050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c173-17b3-4382-a91b-189373a48f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:03.951388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c173-17b3-4382-a91b-189373a48f6d admin admin] PATH_INFO: `/v3/projects/44f2715d947a4154b4c75998486138fe/users/986caccdb7dd430cbe0d77b845280330/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:03.959003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9c173-17b3-4382-a91b-189373a48f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f2715d947a4154b4c75998486138fe, user_id=986caccdb7dd430cbe0d77b845280330, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:03.962079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9c173-17b3-4382-a91b-189373a48f6d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:03.967061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09fec-51eb-4cc7-8898-26707055168a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:03.985142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73406704-18d4-4031-b86c-218c25372127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:03.987496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73406704-18d4-4031-b86c-218c25372127 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:03.987496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73406704-18d4-4031-b86c-218c25372127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:03.987496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73406704-18d4-4031-b86c-218c25372127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:03.997653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 834/1691] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:03 2022] PUT /identity/v3/projects/44f2715d947a4154b4c75998486138fe/users/986caccdb7dd430cbe0d77b845280330/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:03.997653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822f59c-8199-4dea-bfac-6857efc92e82 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:03.997653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822f59c-8199-4dea-bfac-6857efc92e82 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:03.997653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822f59c-8199-4dea-bfac-6857efc92e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:03.999597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73406704-18d4-4031-b86c-218c25372127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:04.001416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73406704-18d4-4031-b86c-218c25372127 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:04.035409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 858/1692] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:04.037438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9bff7-18d3-4e54-9f67-d0859377e1df None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:04.037733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9bff7-18d3-4e54-9f67-d0859377e1df None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:04.038012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9bff7-18d3-4e54-9f67-d0859377e1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:04.039171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-5822f59c-8199-4dea-bfac-6857efc92e82 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:04.041788 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5822f59c-8199-4dea-bfac-6857efc92e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:04.096403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:04.103038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-cef9bff7-18d3-4e54-9f67-d0859377e1df None None] MFA Rules not processed for user `986caccdb7dd430cbe0d77b845280330`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:04.104334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cef9bff7-18d3-4e54-9f67-d0859377e1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:04.210646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 835/1693] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:04.212628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822f59c-8199-4dea-bfac-6857efc92e82 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:04.233060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822f59c-8199-4dea-bfac-6857efc92e82 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:04.254555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29907812-0297-41bd-9206-34d5301d95f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:04.255446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29907812-0297-41bd-9206-34d5301d95f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:04.256376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29907812-0297-41bd-9206-34d5301d95f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:04.257875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29907812-0297-41bd-9206-34d5301d95f7 admin admin] PATH_INFO: `/v3/projects/80420643fff24265bad0cb9cc4b846ab/users/13be10cb6d7642f599966a168477aeb7/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:04.280591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 859/1694] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:04.283050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9bff7-18d3-4e54-9f67-d0859377e1df None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:04.288249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cef9bff7-18d3-4e54-9f67-d0859377e1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:04.311653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29907812-0297-41bd-9206-34d5301d95f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80420643fff24265bad0cb9cc4b846ab, user_id=13be10cb6d7642f599966a168477aeb7, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:04.320307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29907812-0297-41bd-9206-34d5301d95f7 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:04.331107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:04.393398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 836/1695] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:04 2022] PUT /identity/v3/projects/80420643fff24265bad0cb9cc4b846ab/users/13be10cb6d7642f599966a168477aeb7/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:04.395672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25dc3-23ea-4714-b89d-997d3095c8b9 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:04.396647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25dc3-23ea-4714-b89d-997d3095c8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:04.397068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25dc3-23ea-4714-b89d-997d3095c8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:04.414877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9bff7-18d3-4e54-9f67-d0859377e1df None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:04.490689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-5da25dc3-23ea-4714-b89d-997d3095c8b9 None None] MFA Rules not processed for user `9df44d7e1b874671aec8ee0ddfed403b`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:04.495058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5da25dc3-23ea-4714-b89d-997d3095c8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:04.592869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a87aa-f6b4-464f-b53f-54e1cb066746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:04.595298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a87aa-f6b4-464f-b53f-54e1cb066746 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:04.595298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a87aa-f6b4-464f-b53f-54e1cb066746 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:04.597607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a87aa-f6b4-464f-b53f-54e1cb066746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:04.620438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:04.667538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 837/1696] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:04.668467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da25dc3-23ea-4714-b89d-997d3095c8b9 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:04.674364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5da25dc3-23ea-4714-b89d-997d3095c8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:04.759861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a87aa-f6b4-464f-b53f-54e1cb066746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:04.761305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a87aa-f6b4-464f-b53f-54e1cb066746 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:04.785823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 860/1697] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:04.787764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164e962-0acf-45ae-9aa6-d20fdc0ef34e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:04.788055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164e962-0acf-45ae-9aa6-d20fdc0ef34e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:04.788338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164e962-0acf-45ae-9aa6-d20fdc0ef34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:04.796021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:04.800964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da25dc3-23ea-4714-b89d-997d3095c8b9 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:04.805494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedfe7c-1ebc-4d2a-864d-6748683591a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:04.806132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedfe7c-1ebc-4d2a-864d-6748683591a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:04.806415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedfe7c-1ebc-4d2a-864d-6748683591a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:04.806691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedfe7c-1ebc-4d2a-864d-6748683591a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:04.848727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d164e962-0acf-45ae-9aa6-d20fdc0ef34e None None] MFA Rules not processed for user `13be10cb6d7642f599966a168477aeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:04.850613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d164e962-0acf-45ae-9aa6-d20fdc0ef34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:04.932662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedfe7c-1ebc-4d2a-864d-6748683591a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:04.934214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedfe7c-1ebc-4d2a-864d-6748683591a7 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:04.964607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 838/1698] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:04.966101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c315c-a169-460a-a727-8ceff6241130 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:04.966393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c315c-a169-460a-a727-8ceff6241130 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:04.966673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c315c-a169-460a-a727-8ceff6241130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:05.022803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 861/1699] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:05.028777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-9c5c315c-a169-460a-a727-8ceff6241130 None None] MFA Rules not processed for user `9df44d7e1b874671aec8ee0ddfed403b`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:05.028925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8c2ef-28b7-4d5a-a220-3792a9309cd5 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:05.028925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8c2ef-28b7-4d5a-a220-3792a9309cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:05.029083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9c5c315c-a169-460a-a727-8ceff6241130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:05.029162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8c2ef-28b7-4d5a-a220-3792a9309cd5 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:05.031337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 862/1700] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:18:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:18:05.032312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8c2ef-28b7-4d5a-a220-3792a9309cd5 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:05.043051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1bf8c2ef-28b7-4d5a-a220-3792a9309cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:05.054740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 839/1701] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:05.057562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c315c-a169-460a-a727-8ceff6241130 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:05.060937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9c5c315c-a169-460a-a727-8ceff6241130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:05.097234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8c2ef-28b7-4d5a-a220-3792a9309cd5 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:05.107834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:05.108430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c315c-a169-460a-a727-8ceff6241130 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:05.108623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:05.108972 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:05.109375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] PATH_INFO: `/v3/users/f67e1f2019704894be94e6ff6f81be2d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:05.114623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67e1f2019704894be94e6ff6f81be2d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:05.118483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:05.138106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6d7fb-a43b-465b-a791-1cecc1482f6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:05.138610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6d7fb-a43b-465b-a791-1cecc1482f6f service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:05.138900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6d7fb-a43b-465b-a791-1cecc1482f6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:05.139174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6d7fb-a43b-465b-a791-1cecc1482f6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:05.163358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6d7fb-a43b-465b-a791-1cecc1482f6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:05.164998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6d7fb-a43b-465b-a791-1cecc1482f6f service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:05.194896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 840/1702] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:05.195961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6d7fb-a43b-465b-a791-1cecc1482f6f service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:05.203220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b7c6d7fb-a43b-465b-a791-1cecc1482f6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:05.372740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67e1f2019704894be94e6ff6f81be2d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:05.374178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6d7fb-a43b-465b-a791-1cecc1482f6f service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:05.374654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67e1f2019704894be94e6ff6f81be2d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:05.393054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e9279-5421-4daa-9cb7-3da8ecaf4c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:05.394020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e9279-5421-4daa-9cb7-3da8ecaf4c90 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:05.394446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e9279-5421-4daa-9cb7-3da8ecaf4c90 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:05.394864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e9279-5421-4daa-9cb7-3da8ecaf4c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:05.414846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e9279-5421-4daa-9cb7-3da8ecaf4c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:05.416566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e9279-5421-4daa-9cb7-3da8ecaf4c90 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:05.441408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 841/1703] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:05.442750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e9a23-6e41-408c-aad6-4fc3c0d6846a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:05.443039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e9a23-6e41-408c-aad6-4fc3c0d6846a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:05.443318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e9a23-6e41-408c-aad6-4fc3c0d6846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:05.482951 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-bc7e9a23-6e41-408c-aad6-4fc3c0d6846a None None] MFA Rules not processed for user `03a4b508dd7048df83f7beeacfe9c085`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:05.484502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bc7e9a23-6e41-408c-aad6-4fc3c0d6846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:05.533484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67e1f2019704894be94e6ff6f81be2d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:05.534705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67e1f2019704894be94e6ff6f81be2d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:05.543148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67e1f2019704894be94e6ff6f81be2d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:05.579321 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 863/1704] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:05 2022] DELETE /identity/v3/users/f67e1f2019704894be94e6ff6f81be2d => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:05.580210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:05.589888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:05.645108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 842/1705] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:05.704813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e9a23-6e41-408c-aad6-4fc3c0d6846a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:05.706369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bc7e9a23-6e41-408c-aad6-4fc3c0d6846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:05.725430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb90d7-5d7e-4365-affe-e2cc3ed261fa admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:05.726545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d051a7-7dd0-46e9-93dc-111bbd619afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:05.727016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d051a7-7dd0-46e9-93dc-111bbd619afa service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:05.727301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d051a7-7dd0-46e9-93dc-111bbd619afa service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:05.727923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d051a7-7dd0-46e9-93dc-111bbd619afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:05.729344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e9a23-6e41-408c-aad6-4fc3c0d6846a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:05.731153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-12d051a7-7dd0-46e9-93dc-111bbd619afa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:05.847659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d051a7-7dd0-46e9-93dc-111bbd619afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:05.849696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d051a7-7dd0-46e9-93dc-111bbd619afa service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:05.867390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 864/1706] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:05.887839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00976d7-b733-4405-a541-3afc31f38b6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:05.902219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00976d7-b733-4405-a541-3afc31f38b6a service placement] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:05.904648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:05.905208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00976d7-b733-4405-a541-3afc31f38b6a service placement] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:05.908476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00976d7-b733-4405-a541-3afc31f38b6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:05.943531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00976d7-b733-4405-a541-3afc31f38b6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:05.952505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00976d7-b733-4405-a541-3afc31f38b6a service placement] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:05.988152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 843/1707] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:06.253942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:06.435905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b534-5904-4a78-b6b2-f8ca6ea1ac0b None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:06.436286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b534-5904-4a78-b6b2-f8ca6ea1ac0b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:06.436682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b534-5904-4a78-b6b2-f8ca6ea1ac0b None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:06.438180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 865/1708] 10.222.0.27 () {54 vars in 912 bytes} [Fri Sep 9 12:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:18:06.469155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43466be1-4bb4-4418-b980-7496bb8fa9d5 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:06.469454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43466be1-4bb4-4418-b980-7496bb8fa9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:06.469833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43466be1-4bb4-4418-b980-7496bb8fa9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:06.570151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-43466be1-4bb4-4418-b980-7496bb8fa9d5 None None] MFA Rules not processed for user `88d492b570be4de4b6a6d85f6374ed31`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:06.574413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-43466be1-4bb4-4418-b980-7496bb8fa9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:06.691072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:06.710577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 844/1709] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:18:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:06.724742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b534-5904-4a78-b6b2-f8ca6ea1ac0b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:06.726774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3173b534-5904-4a78-b6b2-f8ca6ea1ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:06.752967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b534-5904-4a78-b6b2-f8ca6ea1ac0b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:06.759192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f770ef0-5a46-4a12-96d7-0629bd6dd456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:06.760212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f770ef0-5a46-4a12-96d7-0629bd6dd456 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:06.760951 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f770ef0-5a46-4a12-96d7-0629bd6dd456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:06.761465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f770ef0-5a46-4a12-96d7-0629bd6dd456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:06.770005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f770ef0-5a46-4a12-96d7-0629bd6dd456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:06.772127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f770ef0-5a46-4a12-96d7-0629bd6dd456 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:06.783974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 866/1710] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:06.912254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43466be1-4bb4-4418-b980-7496bb8fa9d5 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:06.916980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-43466be1-4bb4-4418-b980-7496bb8fa9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:07.007416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:07.048609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43466be1-4bb4-4418-b980-7496bb8fa9d5 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:07.055067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:07.055827 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:07.056507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:07.057108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] PATH_INFO: `/v3/projects/3245db2d90184139bab184731e1b37cf` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:07.068642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3245db2d90184139bab184731e1b37cf)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:07.071237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:07.265208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3245db2d90184139bab184731e1b37cf', 'request_id': 'req-5a0502e9-b15b-47d1-8a6d-f98b81a49480'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:07.281083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3245db2d90184139bab184731e1b37cf', 'request_id': 'req-5a0502e9-b15b-47d1-8a6d-f98b81a49480'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:07.323207 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f770ef0-5a46-4a12-96d7-0629bd6dd456 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:07.330301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1f770ef0-5a46-4a12-96d7-0629bd6dd456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:07.360941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f770ef0-5a46-4a12-96d7-0629bd6dd456 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:07.372396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3245db2d90184139bab184731e1b37cf', 'request_id': 'req-5a0502e9-b15b-47d1-8a6d-f98b81a49480'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:07.438591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] The token cache is being invalidate because project 3245db2d90184139bab184731e1b37cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:07.438769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:07.439598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:07.467401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 845/1711] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:06 2022] DELETE /identity/v3/projects/3245db2d90184139bab184731e1b37cf => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:07.468634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:07.473493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:07.707314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:07.717571 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:07.717757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:07.718208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] PATH_INFO: `/v3/projects/5a65efebb1f942528f91f1d8de76aff7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:07.720815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a65efebb1f942528f91f1d8de76aff7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:07.731132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:07.860083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0502e9-b15b-47d1-8a6d-f98b81a49480 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:07.881442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:07.883409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:07.883757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:07.887330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] PATH_INFO: `/v3/users/43c43f568373461ca43b00916fcf8aa1` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:07.891466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c43f568373461ca43b00916fcf8aa1)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:07.896890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:07.998786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a65efebb1f942528f91f1d8de76aff7', 'request_id': 'req-3c56d1c7-3bde-4942-b03b-c634f650a468'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.092839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a65efebb1f942528f91f1d8de76aff7', 'request_id': 'req-3c56d1c7-3bde-4942-b03b-c634f650a468'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.100540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a65efebb1f942528f91f1d8de76aff7', 'request_id': 'req-3c56d1c7-3bde-4942-b03b-c634f650a468'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.140349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] The token cache is being invalidate because project 5a65efebb1f942528f91f1d8de76aff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:08.140720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.145640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.148130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 867/1712] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:07 2022] DELETE /identity/v3/projects/5a65efebb1f942528f91f1d8de76aff7 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:08.166900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:08.173663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:08.214461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:08.267980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c43f568373461ca43b00916fcf8aa1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.325483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56d1c7-3bde-4942-b03b-c634f650a468 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:08.334945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:08.336057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:08.336710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:08.337188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:08.339424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:08.339556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c43f568373461ca43b00916fcf8aa1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.365534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:08.368886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:08.381337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c43f568373461ca43b00916fcf8aa1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.384088 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c43f568373461ca43b00916fcf8aa1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.385773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 868/1713] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:08.387010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:08.388695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:08.413267 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8d2675d2-0338-4d04-bb4d-0c3e23482d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c43f568373461ca43b00916fcf8aa1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:08.421863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 846/1714] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:07 2022] DELETE /identity/v3/users/43c43f568373461ca43b00916fcf8aa1 => generated 0 bytes in 953 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:08.423492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a987-4ac3-4273-bb4c-d247fbc99c75 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:08.424008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a987-4ac3-4273-bb4c-d247fbc99c75 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:08.424478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a987-4ac3-4273-bb4c-d247fbc99c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:08.488820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-cdd3a987-4ac3-4273-bb4c-d247fbc99c75 None None] MFA Rules not processed for user `04c3b6e933a9414593d7552aa960967d`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:08.499713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cdd3a987-4ac3-4273-bb4c-d247fbc99c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:08.548029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40814de-170d-4dfc-b0f4-a8c08045c01d service placement] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:08.720630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 847/1715] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:08.732853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8c19-3c75-4122-a726-81848c2a4545 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:08.733257 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8c19-3c75-4122-a726-81848c2a4545 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:08.733661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8c19-3c75-4122-a726-81848c2a4545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:08.765359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:08.766458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:08.766936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:08.767397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] PATH_INFO: `/v3/users/e5f400e4c5144293b61c281d28074a24` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:08.795234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f400e4c5144293b61c281d28074a24)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:08.801633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:08.805027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e73d8c19-3c75-4122-a726-81848c2a4545 None None] MFA Rules not processed for user `04c3b6e933a9414593d7552aa960967d`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:08.814610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e73d8c19-3c75-4122-a726-81848c2a4545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:08.843718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 848/1716] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:08.854169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d8c19-3c75-4122-a726-81848c2a4545 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:08.856330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e73d8c19-3c75-4122-a726-81848c2a4545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:09.116471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f400e4c5144293b61c281d28074a24'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:09.120160 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f400e4c5144293b61c281d28074a24'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:09.140687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d8c19-3c75-4122-a726-81848c2a4545 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:09.165368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789220e-4ce7-4b1f-a809-2221946c0aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:09.170601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789220e-4ce7-4b1f-a809-2221946c0aea service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:09.170983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789220e-4ce7-4b1f-a809-2221946c0aea service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:09.171459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789220e-4ce7-4b1f-a809-2221946c0aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:09.185341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789220e-4ce7-4b1f-a809-2221946c0aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:09.187259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789220e-4ce7-4b1f-a809-2221946c0aea service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:09.206489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f400e4c5144293b61c281d28074a24'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:09.207349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 849/1717] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:18:09.207480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f400e4c5144293b61c281d28074a24'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:09.209988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795f77a-7988-42b9-849a-e3cc72ffbd00 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:09.210719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795f77a-7988-42b9-849a-e3cc72ffbd00 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:09.210719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795f77a-7988-42b9-849a-e3cc72ffbd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:09.224397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f400e4c5144293b61c281d28074a24'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:09.261100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-3795f77a-7988-42b9-849a-e3cc72ffbd00 None None] MFA Rules not processed for user `504c97036895408b9e04deb0792d5576`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:09.264282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3795f77a-7988-42b9-849a-e3cc72ffbd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:09.267846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 869/1718] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:08 2022] DELETE /identity/v3/users/e5f400e4c5144293b61c281d28074a24 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:09.321353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:09.411841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 850/1719] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:09.734813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:09.737707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:09.853832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07293f83-e1e5-40bf-bf4d-1497e8fb4c7a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:09.902896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:09.904016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:09.909069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:09.909446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] PATH_INFO: `/v3/projects/347ad41192ff448495f4ff126bb8f25c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:09.912095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] RBAC: Authorizing `identity:delete_project(project_id=347ad41192ff448495f4ff126bb8f25c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:09.933585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:10.128150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16b7bd-aac8-425d-8534-06e566a43875 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:10.128451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16b7bd-aac8-425d-8534-06e566a43875 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:10.128729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16b7bd-aac8-425d-8534-06e566a43875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:10.210861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-0a16b7bd-aac8-425d-8534-06e566a43875 None None] MFA Rules not processed for user `be0f76350dc148c6b51705693a1902c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:10.212366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0a16b7bd-aac8-425d-8534-06e566a43875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:10.215074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347ad41192ff448495f4ff126bb8f25c', 'request_id': 'req-cd00b531-9c08-4118-a551-7121c5ae207c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:10.320788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347ad41192ff448495f4ff126bb8f25c', 'request_id': 'req-cd00b531-9c08-4118-a551-7121c5ae207c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:10.342853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347ad41192ff448495f4ff126bb8f25c', 'request_id': 'req-cd00b531-9c08-4118-a551-7121c5ae207c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:10.380791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] The token cache is being invalidate because project 347ad41192ff448495f4ff126bb8f25c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:10.381086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:10.382722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:10.392266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 870/1720] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:09 2022] DELETE /identity/v3/projects/347ad41192ff448495f4ff126bb8f25c => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:10.399893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:10.401530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:10.512822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 851/1721] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:10.512822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1708-5efb-44c7-8eb7-48b8f38fa2c1 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:10.512822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1708-5efb-44c7-8eb7-48b8f38fa2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:10.512822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1708-5efb-44c7-8eb7-48b8f38fa2c1 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:10.514494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 852/1722] 10.222.0.27 () {54 vars in 912 bytes} [Fri Sep 9 12:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:18:10.515872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55612c3c-0408-4e59-9e45-214fa167fb76 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:10.516213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55612c3c-0408-4e59-9e45-214fa167fb76 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:10.516562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55612c3c-0408-4e59-9e45-214fa167fb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:10.567057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-55612c3c-0408-4e59-9e45-214fa167fb76 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:10.568529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-55612c3c-0408-4e59-9e45-214fa167fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:10.573313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:10.579021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00b531-9c08-4118-a551-7121c5ae207c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:10.585118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 853/1723] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:10.586743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e4ea7-5ca8-4be3-bc98-85aa093e79db None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:10.587227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e4ea7-5ca8-4be3-bc98-85aa093e79db None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:10.587581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e4ea7-5ca8-4be3-bc98-85aa093e79db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:10.595685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:10.596556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:10.596970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:10.597147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] PATH_INFO: `/v3/projects/2e62ff2cf3e749ed9b9c1d441cb3e12b` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:10.605471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e62ff2cf3e749ed9b9c1d441cb3e12b)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:10.607525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:10.613925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-c60e4ea7-5ca8-4be3-bc98-85aa093e79db None None] MFA Rules not processed for user `88d492b570be4de4b6a6d85f6374ed31`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:10.615194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c60e4ea7-5ca8-4be3-bc98-85aa093e79db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:10.696370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 854/1724] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:10.699466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1545-cd2b-4071-b45b-c3fe38f88910 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:10.700334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1545-cd2b-4071-b45b-c3fe38f88910 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:10.700961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1545-cd2b-4071-b45b-c3fe38f88910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:10.733213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-53bf1545-cd2b-4071-b45b-c3fe38f88910 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:10.734516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-53bf1545-cd2b-4071-b45b-c3fe38f88910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:10.743217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 855/1725] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:10.744169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1545-cd2b-4071-b45b-c3fe38f88910 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:10.745458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-53bf1545-cd2b-4071-b45b-c3fe38f88910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:10.758428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1545-cd2b-4071-b45b-c3fe38f88910 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:10.765899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:10.765899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:10.766364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:10.767082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] PATH_INFO: `/v3/users/b65071c850964377a767555b40fb6b88` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:10.768767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65071c850964377a767555b40fb6b88)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:10.771779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:10.960233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e62ff2cf3e749ed9b9c1d441cb3e12b', 'request_id': 'req-5d850b23-d7c0-45d6-b5de-5a16db9471c6'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.054953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e62ff2cf3e749ed9b9c1d441cb3e12b', 'request_id': 'req-5d850b23-d7c0-45d6-b5de-5a16db9471c6'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.069322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e62ff2cf3e749ed9b9c1d441cb3e12b', 'request_id': 'req-5d850b23-d7c0-45d6-b5de-5a16db9471c6'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.095746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65071c850964377a767555b40fb6b88'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.101844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] The token cache is being invalidate because project 2e62ff2cf3e749ed9b9c1d441cb3e12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:11.102139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.103607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.109508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 871/1726] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:10 2022] DELETE /identity/v3/projects/2e62ff2cf3e749ed9b9c1d441cb3e12b => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:11.110480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:11.111928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:11.171672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65071c850964377a767555b40fb6b88'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.199661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65071c850964377a767555b40fb6b88'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.201503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65071c850964377a767555b40fb6b88'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.219847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d850b23-d7c0-45d6-b5de-5a16db9471c6 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:11.223028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65071c850964377a767555b40fb6b88'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:11.235467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da68b3-3db9-48ca-a630-fd691a6ad3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:11.238799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da68b3-3db9-48ca-a630-fd691a6ad3de service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:11.239207 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da68b3-3db9-48ca-a630-fd691a6ad3de service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:11.240053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da68b3-3db9-48ca-a630-fd691a6ad3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:11.244703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a3da68b3-3db9-48ca-a630-fd691a6ad3de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:11.246212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 856/1727] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:10 2022] DELETE /identity/v3/users/b65071c850964377a767555b40fb6b88 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:11.247220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:11.251683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:11.272568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da68b3-3db9-48ca-a630-fd691a6ad3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:11.274973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da68b3-3db9-48ca-a630-fd691a6ad3de service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:11.293008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 872/1728] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:11.312911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42aa6a-98e2-4789-971d-821ffa92aeef None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:11.314590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42aa6a-98e2-4789-971d-821ffa92aeef None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:11.314879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42aa6a-98e2-4789-971d-821ffa92aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:11.376710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8c42aa6a-98e2-4789-971d-821ffa92aeef None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:11.379033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8c42aa6a-98e2-4789-971d-821ffa92aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:11.413378 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e71a6-32e9-40ad-905c-48fa2892e7c2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:11.420707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 873/1729] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:11.422595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415726-5c16-48fa-b138-a955e573e069 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:11.423402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415726-5c16-48fa-b138-a955e573e069 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:11.423402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415726-5c16-48fa-b138-a955e573e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:11.438596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34053cd7-6661-481a-9218-5fffb2361ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:11.441919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34053cd7-6661-481a-9218-5fffb2361ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:11.444307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34053cd7-6661-481a-9218-5fffb2361ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:11.444666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34053cd7-6661-481a-9218-5fffb2361ae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:11.446291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34053cd7-6661-481a-9218-5fffb2361ae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:11.447122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34053cd7-6661-481a-9218-5fffb2361ae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:11.456492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34053cd7-6661-481a-9218-5fffb2361ae8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:11.479879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 857/1730] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:11.479879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99867b51-ba14-4b68-abf6-9a81a33c78d6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:11.479879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99867b51-ba14-4b68-abf6-9a81a33c78d6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:11.479879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99867b51-ba14-4b68-abf6-9a81a33c78d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:11.508418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-80415726-5c16-48fa-b138-a955e573e069 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:11.509701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-99867b51-ba14-4b68-abf6-9a81a33c78d6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:11.510243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-80415726-5c16-48fa-b138-a955e573e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:11.513259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-99867b51-ba14-4b68-abf6-9a81a33c78d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:11.525777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 858/1731] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:11.526891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99867b51-ba14-4b68-abf6-9a81a33c78d6 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:11.534559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 874/1732] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:11.538098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415726-5c16-48fa-b138-a955e573e069 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:11.541917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99867b51-ba14-4b68-abf6-9a81a33c78d6 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:11.561213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502a8fb-a888-439c-9546-718f682ccd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:11.563218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502a8fb-a888-439c-9546-718f682ccd9c admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:11.564920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502a8fb-a888-439c-9546-718f682ccd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:11.565303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502a8fb-a888-439c-9546-718f682ccd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:11.566040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502a8fb-a888-439c-9546-718f682ccd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:11.576683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502a8fb-a888-439c-9546-718f682ccd9c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:11.578856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415726-5c16-48fa-b138-a955e573e069 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:11.584210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:11.584850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:11.585135 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:11.585409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:11.586124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:11.586366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:11.588004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:11.620257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 875/1733] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:11.621421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:11.626254 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:11.732200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 859/1734] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:11 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:11.733910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502a8fb-a888-439c-9546-718f682ccd9c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:11.779561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fc02d-4bec-443c-8a8c-8ca0a5b504e5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:11.928414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502a8fb-a888-439c-9546-718f682ccd9c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:11.947796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03563b46-376f-4472-a8e9-5ad27fd8173a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:11.948429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563b46-376f-4472-a8e9-5ad27fd8173a service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:11.948716 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563b46-376f-4472-a8e9-5ad27fd8173a service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:11.948992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563b46-376f-4472-a8e9-5ad27fd8173a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:11.955647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb9713-a5c0-4a2d-8401-9e07f12459f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:11.956545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb9713-a5c0-4a2d-8401-9e07f12459f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:11.959295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb9713-a5c0-4a2d-8401-9e07f12459f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:11.959880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb9713-a5c0-4a2d-8401-9e07f12459f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:11.961532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb9713-a5c0-4a2d-8401-9e07f12459f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:11.967122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb9713-a5c0-4a2d-8401-9e07f12459f0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:11.993001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03563b46-376f-4472-a8e9-5ad27fd8173a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:11.994650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03563b46-376f-4472-a8e9-5ad27fd8173a service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:12.018062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 876/1735] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:12.018904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03563b46-376f-4472-a8e9-5ad27fd8173a service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:12.038752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03563b46-376f-4472-a8e9-5ad27fd8173a service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:12.059090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcde63-5749-41a3-815d-e27b3deb920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:12.059759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcde63-5749-41a3-815d-e27b3deb920e admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.060047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcde63-5749-41a3-815d-e27b3deb920e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.060324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcde63-5749-41a3-815d-e27b3deb920e admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.060973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcde63-5749-41a3-815d-e27b3deb920e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:12.063247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcde63-5749-41a3-815d-e27b3deb920e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:12.096643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 860/1736] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:11 2022] POST /identity/v3/projects => generated 371 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:12.103345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb9713-a5c0-4a2d-8401-9e07f12459f0 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:12.190735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:12.199038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 877/1737] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:12 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:12.204702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcde63-5749-41a3-815d-e27b3deb920e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:12.218040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcde63-5749-41a3-815d-e27b3deb920e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:12.314339 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb9713-a5c0-4a2d-8401-9e07f12459f0 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:12.329961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd825ae0-6c26-49c5-a4f9-761d7960d95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:12.330592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd825ae0-6c26-49c5-a4f9-761d7960d95a admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.330878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd825ae0-6c26-49c5-a4f9-761d7960d95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.331206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd825ae0-6c26-49c5-a4f9-761d7960d95a admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.332141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd825ae0-6c26-49c5-a4f9-761d7960d95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:12.350738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd825ae0-6c26-49c5-a4f9-761d7960d95a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:12.428379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1956ec-f605-40c6-8683-e87b13d1b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:12.429116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1956ec-f605-40c6-8683-e87b13d1b8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.429406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1956ec-f605-40c6-8683-e87b13d1b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.429832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1956ec-f605-40c6-8683-e87b13d1b8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.430505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1956ec-f605-40c6-8683-e87b13d1b8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:12.432160 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1956ec-f605-40c6-8683-e87b13d1b8c5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:12.478905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 878/1738] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:12.480145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1956ec-f605-40c6-8683-e87b13d1b8c5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:12.493183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 861/1739] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:12 2022] POST /identity/v3/users => generated 286 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:12.498302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd825ae0-6c26-49c5-a4f9-761d7960d95a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:12.530980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd825ae0-6c26-49c5-a4f9-761d7960d95a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:12.533674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1956ec-f605-40c6-8683-e87b13d1b8c5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:12.565118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbbea0-1fcc-4419-b109-c9d6f86925bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:12.567927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbbea0-1fcc-4419-b109-c9d6f86925bf admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.568931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbbea0-1fcc-4419-b109-c9d6f86925bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.569719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbbea0-1fcc-4419-b109-c9d6f86925bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.571598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d373e-3df2-47f7-ba70-ebbc0b507eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:12.571757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbbea0-1fcc-4419-b109-c9d6f86925bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:12.572776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d373e-3df2-47f7-ba70-ebbc0b507eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.573075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d373e-3df2-47f7-ba70-ebbc0b507eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.573355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d373e-3df2-47f7-ba70-ebbc0b507eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.574018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d373e-3df2-47f7-ba70-ebbc0b507eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:12.575661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d373e-3df2-47f7-ba70-ebbc0b507eeb admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:12.579926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbbea0-1fcc-4419-b109-c9d6f86925bf admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:12.621111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 879/1740] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:12.623869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 862/1741] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:12.625298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbbea0-1fcc-4419-b109-c9d6f86925bf admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:12.628086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d373e-3df2-47f7-ba70-ebbc0b507eeb admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:12.658359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d373e-3df2-47f7-ba70-ebbc0b507eeb admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:12.664457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b186-fdb7-4a6d-a2e4-0abb79f80110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:12.665571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b186-fdb7-4a6d-a2e4-0abb79f80110 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.665924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b186-fdb7-4a6d-a2e4-0abb79f80110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.666278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b186-fdb7-4a6d-a2e4-0abb79f80110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.667046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11b186-fdb7-4a6d-a2e4-0abb79f80110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:12.668912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11b186-fdb7-4a6d-a2e4-0abb79f80110 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:12.680273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbbea0-1fcc-4419-b109-c9d6f86925bf admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:12.681705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 863/1742] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:12.686122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b186-fdb7-4a6d-a2e4-0abb79f80110 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:12.698469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b186-fdb7-4a6d-a2e4-0abb79f80110 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:12.700178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0f30d-9f7c-4551-b3a7-3587a8bad4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:12.700178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f30d-9f7c-4551-b3a7-3587a8bad4af admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.700585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f30d-9f7c-4551-b3a7-3587a8bad4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.700844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f30d-9f7c-4551-b3a7-3587a8bad4af admin admin] PATH_INFO: `/v3/projects/73e819bb52e84bedb1f1bcb8f3c83402/users/911c3b7e4f424007847effbc6631cdb9/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.704292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d5131-ea95-478f-aa0e-6b4d5c257c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:12.705095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d5131-ea95-478f-aa0e-6b4d5c257c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.706040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d5131-ea95-478f-aa0e-6b4d5c257c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.706418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d5131-ea95-478f-aa0e-6b4d5c257c0e admin admin] PATH_INFO: `/v3/projects/9f2f608f3250438ab525b7d0b476266c/users/5db159b4a8bf49dd866e59d0453244f3/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.761905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d5131-ea95-478f-aa0e-6b4d5c257c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2f608f3250438ab525b7d0b476266c, user_id=5db159b4a8bf49dd866e59d0453244f3, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:12.770315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d5131-ea95-478f-aa0e-6b4d5c257c0e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:12.777623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0f30d-9f7c-4551-b3a7-3587a8bad4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e819bb52e84bedb1f1bcb8f3c83402, user_id=911c3b7e4f424007847effbc6631cdb9, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:12.785622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0f30d-9f7c-4551-b3a7-3587a8bad4af admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:12.860269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 864/1743] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:12 2022] PUT /identity/v3/projects/9f2f608f3250438ab525b7d0b476266c/users/5db159b4a8bf49dd866e59d0453244f3/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:12.871509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010bd64-d44e-4c9e-85a4-796c1a340b19 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.871824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010bd64-d44e-4c9e-85a4-796c1a340b19 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.872099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010bd64-d44e-4c9e-85a4-796c1a340b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.938590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 880/1744] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:12 2022] PUT /identity/v3/projects/73e819bb52e84bedb1f1bcb8f3c83402/users/911c3b7e4f424007847effbc6631cdb9/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:12.940224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b788-4055-4689-9de3-be22312ecc68 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:12.940570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b788-4055-4689-9de3-be22312ecc68 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:12.940872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b788-4055-4689-9de3-be22312ecc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:12.946509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b010bd64-d44e-4c9e-85a4-796c1a340b19 None None] MFA Rules not processed for user `5db159b4a8bf49dd866e59d0453244f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:12.955883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b010bd64-d44e-4c9e-85a4-796c1a340b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:13.034789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6cf8b788-4055-4689-9de3-be22312ecc68 None None] MFA Rules not processed for user `04c3b6e933a9414593d7552aa960967d`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:13.036789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6cf8b788-4055-4689-9de3-be22312ecc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:13.069657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 865/1745] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:13.072212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010bd64-d44e-4c9e-85a4-796c1a340b19 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:13.076279 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b010bd64-d44e-4c9e-85a4-796c1a340b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:13.165962 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 881/1746] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:13.168401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044960d5-80ad-4441-9016-5d2307bf959e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:13.170077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044960d5-80ad-4441-9016-5d2307bf959e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:13.170464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044960d5-80ad-4441-9016-5d2307bf959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:13.250053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-044960d5-80ad-4441-9016-5d2307bf959e None None] MFA Rules not processed for user `911c3b7e4f424007847effbc6631cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:13.252005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-044960d5-80ad-4441-9016-5d2307bf959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:13.289683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010bd64-d44e-4c9e-85a4-796c1a340b19 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:13.295331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:13.296027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:13.296653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:13.296941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] PATH_INFO: `/v3/projects/64e8567321d7448e938c87d86eb64b5a` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:13.298318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e8567321d7448e938c87d86eb64b5a)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:13.302150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:13.401650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 882/1747] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:13.404316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044960d5-80ad-4441-9016-5d2307bf959e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:13.447029 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044960d5-80ad-4441-9016-5d2307bf959e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:13.460196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea608a-118c-4aa4-90c5-54740c7f1f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:13.461040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea608a-118c-4aa4-90c5-54740c7f1f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:13.461517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea608a-118c-4aa4-90c5-54740c7f1f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:13.461997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea608a-118c-4aa4-90c5-54740c7f1f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:13.462980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea608a-118c-4aa4-90c5-54740c7f1f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:13.473846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea608a-118c-4aa4-90c5-54740c7f1f54 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:13.547532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e8567321d7448e938c87d86eb64b5a', 'request_id': 'req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:13.569306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e8567321d7448e938c87d86eb64b5a', 'request_id': 'req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:13.636731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:13.643467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 883/1748] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:13 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:13.644763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea608a-118c-4aa4-90c5-54740c7f1f54 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:13.658896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e8567321d7448e938c87d86eb64b5a', 'request_id': 'req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:13.677968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] The token cache is being invalidate because project 64e8567321d7448e938c87d86eb64b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:13.679151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:13.681426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:13.685290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 866/1749] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:13 2022] DELETE /identity/v3/projects/64e8567321d7448e938c87d86eb64b5a => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:13.688578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:13.692358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:13.811692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea608a-118c-4aa4-90c5-54740c7f1f54 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:13.825229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bae770-bafa-41bf-9baf-55320fdfa21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:13.828952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bae770-bafa-41bf-9baf-55320fdfa21a admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:13.829220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bae770-bafa-41bf-9baf-55320fdfa21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:13.829486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bae770-bafa-41bf-9baf-55320fdfa21a admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:13.830229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bae770-bafa-41bf-9baf-55320fdfa21a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:13.832422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3d8f-44d0-41aa-9b0a-7988c1eb0852 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:13.836748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bae770-bafa-41bf-9baf-55320fdfa21a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:13.866504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0b19e-8e44-4dbf-bf1b-8983ed64c206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:13.868388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0b19e-8e44-4dbf-bf1b-8983ed64c206 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:13.879219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0b19e-8e44-4dbf-bf1b-8983ed64c206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:13.879219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0b19e-8e44-4dbf-bf1b-8983ed64c206 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:13.879219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0b19e-8e44-4dbf-bf1b-8983ed64c206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:13.880314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0b19e-8e44-4dbf-bf1b-8983ed64c206 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:13.995679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 867/1750] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:13 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:13.995770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 884/1751] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:13 2022] POST /identity/v3/projects => generated 369 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:13.997318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bae770-bafa-41bf-9baf-55320fdfa21a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:13.997722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0b19e-8e44-4dbf-bf1b-8983ed64c206 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:14.001212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-84e0b19e-8e44-4dbf-bf1b-8983ed64c206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:14.048256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:14.064314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0b19e-8e44-4dbf-bf1b-8983ed64c206 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:14.222995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bae770-bafa-41bf-9baf-55320fdfa21a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:14.229002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62accc9-f208-4b95-be6e-5d4513ae3190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:14.229776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62accc9-f208-4b95-be6e-5d4513ae3190 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:14.230175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62accc9-f208-4b95-be6e-5d4513ae3190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:14.230542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62accc9-f208-4b95-be6e-5d4513ae3190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:14.232945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62accc9-f208-4b95-be6e-5d4513ae3190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:14.234717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62accc9-f208-4b95-be6e-5d4513ae3190 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:14.291541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:14.292320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:14.292610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:14.292891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] PATH_INFO: `/v3/users/986caccdb7dd430cbe0d77b845280330` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:14.298576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=986caccdb7dd430cbe0d77b845280330)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:14.298946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 885/1752] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:14.299982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62accc9-f208-4b95-be6e-5d4513ae3190 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:14.303985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:14.304561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f62accc9-f208-4b95-be6e-5d4513ae3190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:14.334138 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62accc9-f208-4b95-be6e-5d4513ae3190 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:14.343058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acffa38-3544-4e80-a742-79a40fcdbcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:14.345915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acffa38-3544-4e80-a742-79a40fcdbcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:14.346731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acffa38-3544-4e80-a742-79a40fcdbcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:14.347235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acffa38-3544-4e80-a742-79a40fcdbcd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:14.348251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acffa38-3544-4e80-a742-79a40fcdbcd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:14.351075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acffa38-3544-4e80-a742-79a40fcdbcd4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:14.511540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 886/1753] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:14 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:14.515208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5cf70-99a4-4130-9c2f-f6e91e13460b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:14.519300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5cf70-99a4-4130-9c2f-f6e91e13460b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:14.521186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5cf70-99a4-4130-9c2f-f6e91e13460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:14.635137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986caccdb7dd430cbe0d77b845280330'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:14.737845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ece5cf70-99a4-4130-9c2f-f6e91e13460b None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:14.740538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ece5cf70-99a4-4130-9c2f-f6e91e13460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:14.777681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986caccdb7dd430cbe0d77b845280330'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:14.801343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986caccdb7dd430cbe0d77b845280330'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:14.803309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986caccdb7dd430cbe0d77b845280330'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:14.852756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986caccdb7dd430cbe0d77b845280330'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:14.876302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 868/1754] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:13 2022] DELETE /identity/v3/users/986caccdb7dd430cbe0d77b845280330 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:14.877367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:14.879550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:14.995545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 887/1755] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:15.000316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5cf70-99a4-4130-9c2f-f6e91e13460b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:15.004523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ece5cf70-99a4-4130-9c2f-f6e91e13460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:15.055451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5cf70-99a4-4130-9c2f-f6e91e13460b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:15.070163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816e64a-77a9-4053-a255-293ba8700509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:15.070827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816e64a-77a9-4053-a255-293ba8700509 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:15.071117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816e64a-77a9-4053-a255-293ba8700509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:15.071394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816e64a-77a9-4053-a255-293ba8700509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:15.080290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5de05c-c5b3-41ba-9c8c-2bcf153fed62 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:15.080373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816e64a-77a9-4053-a255-293ba8700509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:15.080459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41713376-5c88-4d7b-a4f1-a4ca8061e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:15.080459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41713376-5c88-4d7b-a4f1-a4ca8061e5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:15.080612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816e64a-77a9-4053-a255-293ba8700509 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:15.080721 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41713376-5c88-4d7b-a4f1-a4ca8061e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:15.080721 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41713376-5c88-4d7b-a4f1-a4ca8061e5ab admin admin] PATH_INFO: `/v3/projects/6fb95e19aaa948478060a0b7684768de/users/fa03b439c33a4b298d1a730d1c1e972b/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:15.105277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41713376-5c88-4d7b-a4f1-a4ca8061e5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb95e19aaa948478060a0b7684768de, user_id=fa03b439c33a4b298d1a730d1c1e972b, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:15.108363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41713376-5c88-4d7b-a4f1-a4ca8061e5ab admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:15.119434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 888/1756] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:15.123663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816e64a-77a9-4053-a255-293ba8700509 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:15.145016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816e64a-77a9-4053-a255-293ba8700509 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:15.168337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3eff-db21-4028-bede-4f27b3bb315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:15.169096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3eff-db21-4028-bede-4f27b3bb315d admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:15.169479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3eff-db21-4028-bede-4f27b3bb315d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:15.169652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3eff-db21-4028-bede-4f27b3bb315d admin admin] PATH_INFO: `/v3/projects/9b2f8c905619412998f041a1f1b5995b/users/feeb021420fa4bcbb3337165acd43228/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:15.203663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 869/1757] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:14 2022] PUT /identity/v3/projects/6fb95e19aaa948478060a0b7684768de/users/fa03b439c33a4b298d1a730d1c1e972b/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:15.204236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41713376-5c88-4d7b-a4f1-a4ca8061e5ab admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:15.206686 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb3eff-db21-4028-bede-4f27b3bb315d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2f8c905619412998f041a1f1b5995b, user_id=feeb021420fa4bcbb3337165acd43228, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:15.211087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb3eff-db21-4028-bede-4f27b3bb315d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:15.322230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 889/1758] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:15 2022] PUT /identity/v3/projects/9b2f8c905619412998f041a1f1b5995b/users/feeb021420fa4bcbb3337165acd43228/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:15.323355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3eff-db21-4028-bede-4f27b3bb315d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:15.427825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41713376-5c88-4d7b-a4f1-a4ca8061e5ab admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:15.554861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3eff-db21-4028-bede-4f27b3bb315d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:15.566371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e86ee2-97ec-4840-99ca-3f0444726b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:15.568436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e86ee2-97ec-4840-99ca-3f0444726b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:15.568436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e86ee2-97ec-4840-99ca-3f0444726b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:15.570632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e86ee2-97ec-4840-99ca-3f0444726b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:15.571261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e86ee2-97ec-4840-99ca-3f0444726b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:15.573356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e86ee2-97ec-4840-99ca-3f0444726b47 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:15.605294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 890/1759] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:15.607053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e86ee2-97ec-4840-99ca-3f0444726b47 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:15.612421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-31e86ee2-97ec-4840-99ca-3f0444726b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:15.625321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e8ac7-7335-4070-9c65-e9b19387e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:15.625970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e8ac7-7335-4070-9c65-e9b19387e0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:15.626233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e8ac7-7335-4070-9c65-e9b19387e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:15.626508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e8ac7-7335-4070-9c65-e9b19387e0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:15.628242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e8ac7-7335-4070-9c65-e9b19387e0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:15.633349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e8ac7-7335-4070-9c65-e9b19387e0f3 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:15.659427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 870/1760] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:15.663419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e8ac7-7335-4070-9c65-e9b19387e0f3 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:15.707080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e8ac7-7335-4070-9c65-e9b19387e0f3 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:15.721160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484a640-5a20-4886-8cc1-ccb9f32a1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:15.721845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484a640-5a20-4886-8cc1-ccb9f32a1de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:15.722125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484a640-5a20-4886-8cc1-ccb9f32a1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:15.722614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484a640-5a20-4886-8cc1-ccb9f32a1de2 admin admin] PATH_INFO: `/v3/projects/9b2f8c905619412998f041a1f1b5995b/users/feeb021420fa4bcbb3337165acd43228/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:15.729311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484a640-5a20-4886-8cc1-ccb9f32a1de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2f8c905619412998f041a1f1b5995b, user_id=feeb021420fa4bcbb3337165acd43228, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:15.733333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484a640-5a20-4886-8cc1-ccb9f32a1de2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:15.778885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 871/1761] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:15 2022] PUT /identity/v3/projects/9b2f8c905619412998f041a1f1b5995b/users/feeb021420fa4bcbb3337165acd43228/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:15.782482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484a640-5a20-4886-8cc1-ccb9f32a1de2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:15.877817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:15.954035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e86ee2-97ec-4840-99ca-3f0444726b47 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:16.037722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484a640-5a20-4886-8cc1-ccb9f32a1de2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:16.053380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8799b-15b8-4e45-88fc-fb10b473d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:16.054221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8799b-15b8-4e45-88fc-fb10b473d84d admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:16.054374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8799b-15b8-4e45-88fc-fb10b473d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:16.054652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8799b-15b8-4e45-88fc-fb10b473d84d admin admin] PATH_INFO: `/v3/projects/6fb95e19aaa948478060a0b7684768de/users/fa03b439c33a4b298d1a730d1c1e972b/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:16.058452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8799b-15b8-4e45-88fc-fb10b473d84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb95e19aaa948478060a0b7684768de, user_id=fa03b439c33a4b298d1a730d1c1e972b, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:16.065231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8799b-15b8-4e45-88fc-fb10b473d84d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:16.105210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0783da-8081-4a57-b527-7f6430df7186 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:16.105930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0783da-8081-4a57-b527-7f6430df7186 service swift] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:16.106219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0783da-8081-4a57-b527-7f6430df7186 service swift] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:16.106768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0783da-8081-4a57-b527-7f6430df7186 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:16.116911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 872/1762] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:15 2022] PUT /identity/v3/projects/6fb95e19aaa948478060a0b7684768de/users/fa03b439c33a4b298d1a730d1c1e972b/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:16.133320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a990d-0120-49cf-a853-d7c67c1a7358 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:16.133320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a990d-0120-49cf-a853-d7c67c1a7358 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:16.133320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a990d-0120-49cf-a853-d7c67c1a7358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:16.180862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-534a990d-0120-49cf-a853-d7c67c1a7358 None None] MFA Rules not processed for user `feeb021420fa4bcbb3337165acd43228`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:16.182421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-534a990d-0120-49cf-a853-d7c67c1a7358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:16.255026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0783da-8081-4a57-b527-7f6430df7186 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:16.257153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0783da-8081-4a57-b527-7f6430df7186 service swift] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:16.269773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 891/1763] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:18:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:18:16.277504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418c10-32cc-433a-b2c3-fb1ace9c6fce None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:16.277504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418c10-32cc-433a-b2c3-fb1ace9c6fce None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:16.277504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418c10-32cc-433a-b2c3-fb1ace9c6fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:16.313698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-27418c10-32cc-433a-b2c3-fb1ace9c6fce None None] MFA Rules not processed for user `fa03b439c33a4b298d1a730d1c1e972b`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:16.315151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-27418c10-32cc-433a-b2c3-fb1ace9c6fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:16.423861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:16.503689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 873/1764] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:16.504159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a990d-0120-49cf-a853-d7c67c1a7358 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:16.531814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-534a990d-0120-49cf-a853-d7c67c1a7358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:16.820782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 892/1765] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:16.824575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418c10-32cc-433a-b2c3-fb1ace9c6fce None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:16.828338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-27418c10-32cc-433a-b2c3-fb1ace9c6fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:16.908925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a990d-0120-49cf-a853-d7c67c1a7358 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:16.926837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:16.929618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:16.929798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:16.930215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] PATH_INFO: `/v3/projects/44f2715d947a4154b4c75998486138fe` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:16.936777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f2715d947a4154b4c75998486138fe)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:16.939030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:16.952920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418c10-32cc-433a-b2c3-fb1ace9c6fce None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:16.963120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c314-9dbe-4029-ab84-37894d927546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:16.969371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c314-9dbe-4029-ab84-37894d927546 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:16.969803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c314-9dbe-4029-ab84-37894d927546 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:16.973007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c314-9dbe-4029-ab84-37894d927546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:17.018903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871c314-9dbe-4029-ab84-37894d927546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:17.026742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871c314-9dbe-4029-ab84-37894d927546 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:17.092117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 893/1766] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:17.097230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c314-9dbe-4029-ab84-37894d927546 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:17.099510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3871c314-9dbe-4029-ab84-37894d927546 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:17.163380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c314-9dbe-4029-ab84-37894d927546 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:17.175999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3075e0-3228-4fcb-9ce6-ca196535adf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:17.176643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3075e0-3228-4fcb-9ce6-ca196535adf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:17.177463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3075e0-3228-4fcb-9ce6-ca196535adf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:17.191331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3075e0-3228-4fcb-9ce6-ca196535adf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:17.263269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f2715d947a4154b4c75998486138fe', 'request_id': 'req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:17.265966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3075e0-3228-4fcb-9ce6-ca196535adf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:17.289283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f2715d947a4154b4c75998486138fe', 'request_id': 'req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:17.295242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3075e0-3228-4fcb-9ce6-ca196535adf2 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:17.347295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 894/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:17.369188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c33a1-8f4a-4d39-bb5b-0115d54221cd None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:17.376244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c33a1-8f4a-4d39-bb5b-0115d54221cd None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:17.376600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c33a1-8f4a-4d39-bb5b-0115d54221cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:17.383170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f2715d947a4154b4c75998486138fe', 'request_id': 'req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:17.401466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] The token cache is being invalidate because project 44f2715d947a4154b4c75998486138fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:17.402000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:17.404334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a6a24ee1-01c8-45ca-ae89-e3a21c2bfd82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:17.407336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 874/1768] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:16 2022] DELETE /identity/v3/projects/44f2715d947a4154b4c75998486138fe => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:17.413031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f085cb1-ee03-446e-8da6-576402a2a9e7 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:17.413567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f085cb1-ee03-446e-8da6-576402a2a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:17.414605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f085cb1-ee03-446e-8da6-576402a2a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:17.495463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6f085cb1-ee03-446e-8da6-576402a2a9e7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:17.497330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6f085cb1-ee03-446e-8da6-576402a2a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:17.530612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2e6c33a1-8f4a-4d39-bb5b-0115d54221cd None None] MFA Rules not processed for user `88d492b570be4de4b6a6d85f6374ed31`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:17.545115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2e6c33a1-8f4a-4d39-bb5b-0115d54221cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:17.693387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 895/1769] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Sep 9 12:18:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:17.708622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f50a-b4c4-45e3-9f25-5e86589685d8 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:17.708911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f50a-b4c4-45e3-9f25-5e86589685d8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:17.709186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f50a-b4c4-45e3-9f25-5e86589685d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:17.712501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 875/1770] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:17.731281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f085cb1-ee03-446e-8da6-576402a2a9e7 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:17.735363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6f085cb1-ee03-446e-8da6-576402a2a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:17.761456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3e24f50a-b4c4-45e3-9f25-5e86589685d8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:17.763492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3e24f50a-b4c4-45e3-9f25-5e86589685d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:17.783530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 896/1771] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:17.783530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24f50a-b4c4-45e3-9f25-5e86589685d8 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:17.792550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24f50a-b4c4-45e3-9f25-5e86589685d8 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:17.805506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599621a-6274-4438-a715-8caf54f19822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:17.810187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599621a-6274-4438-a715-8caf54f19822 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:17.810187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599621a-6274-4438-a715-8caf54f19822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:17.810187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599621a-6274-4438-a715-8caf54f19822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:17.810187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599621a-6274-4438-a715-8caf54f19822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:17.810187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599621a-6274-4438-a715-8caf54f19822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:17.810187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599621a-6274-4438-a715-8caf54f19822 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:17.832084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 897/1772] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:17.837007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599621a-6274-4438-a715-8caf54f19822 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:17.848216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:17.879027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599621a-6274-4438-a715-8caf54f19822 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:17.884528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397130-34e7-4561-8b12-99367c58967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:17.885097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397130-34e7-4561-8b12-99367c58967a admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:17.889639 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397130-34e7-4561-8b12-99367c58967a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:17.890682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397130-34e7-4561-8b12-99367c58967a admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:17.891539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c397130-34e7-4561-8b12-99367c58967a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:17.893903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c397130-34e7-4561-8b12-99367c58967a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:17.927377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f085cb1-ee03-446e-8da6-576402a2a9e7 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:17.931566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:17.935263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:17.935557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:17.935932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:17.938492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:17.990133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 898/1773] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:17 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:17.992758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397130-34e7-4561-8b12-99367c58967a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:18.003717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:18.064359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:18.068282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:18.097601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 876/1774] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:18.151989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:18.154147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:18.173064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d619210-fc2a-4554-a6f7-fd252092fe95 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:18.199236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397130-34e7-4561-8b12-99367c58967a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:18.221864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec75cb-0af1-453c-950e-9b315568eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:18.221864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec75cb-0af1-453c-950e-9b315568eb09 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:18.221864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec75cb-0af1-453c-950e-9b315568eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:18.221864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec75cb-0af1-453c-950e-9b315568eb09 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:18.222392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec75cb-0af1-453c-950e-9b315568eb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:18.228930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec75cb-0af1-453c-950e-9b315568eb09 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:18.327107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07c63-1995-45fd-bdd0-a2a1acddbc5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:18.328793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07c63-1995-45fd-bdd0-a2a1acddbc5e service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:18.329637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07c63-1995-45fd-bdd0-a2a1acddbc5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:18.330388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07c63-1995-45fd-bdd0-a2a1acddbc5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:18.343273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b07c63-1995-45fd-bdd0-a2a1acddbc5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:18.346087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b07c63-1995-45fd-bdd0-a2a1acddbc5e service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:18.358535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 877/1775] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:18:18.579342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 899/1776] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:17 2022] POST /identity/v3/users => generated 289 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:18.584410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07c63-1995-45fd-bdd0-a2a1acddbc5e service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:18.602295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07c63-1995-45fd-bdd0-a2a1acddbc5e service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:18.616374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92e59e-8407-4a4f-8fab-f5b1a5aad27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:18.617560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92e59e-8407-4a4f-8fab-f5b1a5aad27b admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:18.618019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92e59e-8407-4a4f-8fab-f5b1a5aad27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:18.619494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92e59e-8407-4a4f-8fab-f5b1a5aad27b admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:18.621099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92e59e-8407-4a4f-8fab-f5b1a5aad27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:18.623585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92e59e-8407-4a4f-8fab-f5b1a5aad27b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:18.641672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 878/1777] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:18.683763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec75cb-0af1-453c-950e-9b315568eb09 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:18.683763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec75cb-0af1-453c-950e-9b315568eb09 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:18.687900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd9c8-9bc9-41d8-9df4-f28a9d1a5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:18.688570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd9c8-9bc9-41d8-9df4-f28a9d1a5c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:18.688898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd9c8-9bc9-41d8-9df4-f28a9d1a5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:18.690932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd9c8-9bc9-41d8-9df4-f28a9d1a5c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:18.690932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd9c8-9bc9-41d8-9df4-f28a9d1a5c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:18.693382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd9c8-9bc9-41d8-9df4-f28a9d1a5c5a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:18.708603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:18.729530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 900/1778] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:18.732682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92e59e-8407-4a4f-8fab-f5b1a5aad27b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:18.768757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92e59e-8407-4a4f-8fab-f5b1a5aad27b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:18.789687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615abf-56fa-47bd-9b46-f1971843ef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:18.790977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615abf-56fa-47bd-9b46-f1971843ef0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:18.792104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615abf-56fa-47bd-9b46-f1971843ef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:18.793236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615abf-56fa-47bd-9b46-f1971843ef0c admin admin] PATH_INFO: `/v3/projects/9676b7b0870e4565899ab1f6384d6ec4/users/7d5a991da7d04a5da1e0f6a1c1b2fbe7/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:18.818584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37615abf-56fa-47bd-9b46-f1971843ef0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9676b7b0870e4565899ab1f6384d6ec4, user_id=7d5a991da7d04a5da1e0f6a1c1b2fbe7, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:18.822205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37615abf-56fa-47bd-9b46-f1971843ef0c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:19.097439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 879/1779] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:18 2022] PUT /identity/v3/projects/9676b7b0870e4565899ab1f6384d6ec4/users/7d5a991da7d04a5da1e0f6a1c1b2fbe7/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:19.101969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d58be-c310-491c-80f5-552b88708eed None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:19.102545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d58be-c310-491c-80f5-552b88708eed None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:19.105425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d58be-c310-491c-80f5-552b88708eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:19.192426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ea5d58be-c310-491c-80f5-552b88708eed None None] MFA Rules not processed for user `7d5a991da7d04a5da1e0f6a1c1b2fbe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:19.194213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ea5d58be-c310-491c-80f5-552b88708eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:19.284659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:19.397770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 901/1780] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:19.402322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615abf-56fa-47bd-9b46-f1971843ef0c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:19.596450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615abf-56fa-47bd-9b46-f1971843ef0c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:19.609937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3dcec-2583-46a4-abfd-24b14ec5cf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:19.609937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3dcec-2583-46a4-abfd-24b14ec5cf33 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:19.611871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3dcec-2583-46a4-abfd-24b14ec5cf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:19.612325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3dcec-2583-46a4-abfd-24b14ec5cf33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:19.614630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3dcec-2583-46a4-abfd-24b14ec5cf33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:19.619511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3dcec-2583-46a4-abfd-24b14ec5cf33 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:19.756266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 880/1781] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:19 2022] POST /identity/v3/projects => generated 375 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:19.759090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d58be-c310-491c-80f5-552b88708eed None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:19.798708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d58be-c310-491c-80f5-552b88708eed None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:19.941561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2a61e-5ec8-4dac-9d0b-50ebfc8329ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:19.948386 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2a61e-5ec8-4dac-9d0b-50ebfc8329ba admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:19.948766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2a61e-5ec8-4dac-9d0b-50ebfc8329ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:19.950090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2a61e-5ec8-4dac-9d0b-50ebfc8329ba admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:19.950324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2a61e-5ec8-4dac-9d0b-50ebfc8329ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:19.956101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2a61e-5ec8-4dac-9d0b-50ebfc8329ba admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:20.058384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 902/1782] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:19 2022] POST /identity/v3/users => generated 294 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:20.062360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3dcec-2583-46a4-abfd-24b14ec5cf33 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:20.080353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3dcec-2583-46a4-abfd-24b14ec5cf33 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:20.096782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b402a-ba6a-4087-a1e1-16557cbbadc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:20.098853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b402a-ba6a-4087-a1e1-16557cbbadc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:20.098853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b402a-ba6a-4087-a1e1-16557cbbadc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:20.098853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b402a-ba6a-4087-a1e1-16557cbbadc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:20.099561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b402a-ba6a-4087-a1e1-16557cbbadc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:20.108694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b402a-ba6a-4087-a1e1-16557cbbadc5 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:20.137011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 881/1783] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:20.141035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2a61e-5ec8-4dac-9d0b-50ebfc8329ba admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:20.156617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2a61e-5ec8-4dac-9d0b-50ebfc8329ba admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:20.171096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba21611-0440-4e4f-b2d4-b5b9260fd194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:20.172064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba21611-0440-4e4f-b2d4-b5b9260fd194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:20.172526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba21611-0440-4e4f-b2d4-b5b9260fd194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:20.173226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba21611-0440-4e4f-b2d4-b5b9260fd194 admin admin] PATH_INFO: `/v3/projects/e6a72e919e524ee9afb2df1eb1bafee3/users/c383992dde6b4cc5b6dd31314e3e2af1/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:20.241128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba21611-0440-4e4f-b2d4-b5b9260fd194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a72e919e524ee9afb2df1eb1bafee3, user_id=c383992dde6b4cc5b6dd31314e3e2af1, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:20.244185 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba21611-0440-4e4f-b2d4-b5b9260fd194 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:20.359402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 903/1784] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:20 2022] PUT /identity/v3/projects/e6a72e919e524ee9afb2df1eb1bafee3/users/c383992dde6b4cc5b6dd31314e3e2af1/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:20.363951 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b402a-ba6a-4087-a1e1-16557cbbadc5 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:20.386151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b402a-ba6a-4087-a1e1-16557cbbadc5 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:20.429859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:20.586279 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81444c-b25f-4336-a225-fa701009f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:20.589171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81444c-b25f-4336-a225-fa701009f5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:20.589171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81444c-b25f-4336-a225-fa701009f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:20.589171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81444c-b25f-4336-a225-fa701009f5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:20.589171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81444c-b25f-4336-a225-fa701009f5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:20.601875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81444c-b25f-4336-a225-fa701009f5b0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:20.621725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 882/1785] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:20.625865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba21611-0440-4e4f-b2d4-b5b9260fd194 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:20.636861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba21611-0440-4e4f-b2d4-b5b9260fd194 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:20.641782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6b479-5525-4210-a73e-c7b72e4d35e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:20.648753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6b479-5525-4210-a73e-c7b72e4d35e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:20.648753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6b479-5525-4210-a73e-c7b72e4d35e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:20.648753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6b479-5525-4210-a73e-c7b72e4d35e0 admin admin] PATH_INFO: `/v3/projects/e6a72e919e524ee9afb2df1eb1bafee3/users/c383992dde6b4cc5b6dd31314e3e2af1/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:20.648753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6b479-5525-4210-a73e-c7b72e4d35e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a72e919e524ee9afb2df1eb1bafee3, user_id=c383992dde6b4cc5b6dd31314e3e2af1, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:20.648753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6b479-5525-4210-a73e-c7b72e4d35e0 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:20.686823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 904/1786] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:20 2022] PUT /identity/v3/projects/e6a72e919e524ee9afb2df1eb1bafee3/users/c383992dde6b4cc5b6dd31314e3e2af1/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:20.697506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2950413-7537-4594-99cf-3107e295d051 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:20.697796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2950413-7537-4594-99cf-3107e295d051 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:20.698076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2950413-7537-4594-99cf-3107e295d051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:20.743428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f2950413-7537-4594-99cf-3107e295d051 None None] MFA Rules not processed for user `c383992dde6b4cc5b6dd31314e3e2af1`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:20.750223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f2950413-7537-4594-99cf-3107e295d051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:20.897199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:20.928285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 883/1787] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:21.195616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6b479-5525-4210-a73e-c7b72e4d35e0 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:21.197309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4ac6b479-5525-4210-a73e-c7b72e4d35e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:21.339395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6b479-5525-4210-a73e-c7b72e4d35e0 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:21.352729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12becfa8-5124-4896-8507-124bf55a1d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:21.353487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12becfa8-5124-4896-8507-124bf55a1d3a service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:21.353778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12becfa8-5124-4896-8507-124bf55a1d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:21.354054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12becfa8-5124-4896-8507-124bf55a1d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:21.416465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad03b-464c-4bc3-b87e-24d57f30a5c4 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:21.417165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad03b-464c-4bc3-b87e-24d57f30a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:21.417165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad03b-464c-4bc3-b87e-24d57f30a5c4 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:21.418991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 884/1788] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:18:21.430662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:21.456547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751795b0-bd3b-43a7-9c99-3c95ca1543e5 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:21.457178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751795b0-bd3b-43a7-9c99-3c95ca1543e5 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:21.457693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751795b0-bd3b-43a7-9c99-3c95ca1543e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:21.516535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12becfa8-5124-4896-8507-124bf55a1d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:21.517342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-751795b0-bd3b-43a7-9c99-3c95ca1543e5 None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:21.518209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12becfa8-5124-4896-8507-124bf55a1d3a service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:21.521898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-751795b0-bd3b-43a7-9c99-3c95ca1543e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:21.535887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 905/1789] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:21.742594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 885/1790] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:18:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:21.800843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:22.209357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12becfa8-5124-4896-8507-124bf55a1d3a service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:22.209357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-12becfa8-5124-4896-8507-124bf55a1d3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:22.209357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12becfa8-5124-4896-8507-124bf55a1d3a service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:22.210439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778efbc-95e3-4e06-b90f-ad7b9c71ccd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:22.210439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778efbc-95e3-4e06-b90f-ad7b9c71ccd5 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:22.210439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778efbc-95e3-4e06-b90f-ad7b9c71ccd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:22.210439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778efbc-95e3-4e06-b90f-ad7b9c71ccd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:22.210969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778efbc-95e3-4e06-b90f-ad7b9c71ccd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:22.215016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778efbc-95e3-4e06-b90f-ad7b9c71ccd5 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:22.234542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:22.249947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 906/1791] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:22.271988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751795b0-bd3b-43a7-9c99-3c95ca1543e5 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:22.283676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-751795b0-bd3b-43a7-9c99-3c95ca1543e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:22.450220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751795b0-bd3b-43a7-9c99-3c95ca1543e5 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:22.472982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:22.473680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:22.473970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:22.474253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] PATH_INFO: `/v3/users/13be10cb6d7642f599966a168477aeb7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:22.478765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13be10cb6d7642f599966a168477aeb7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:22.479156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:22.821570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13be10cb6d7642f599966a168477aeb7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:22.967092 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13be10cb6d7642f599966a168477aeb7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:22.995272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13be10cb6d7642f599966a168477aeb7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:23.000007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13be10cb6d7642f599966a168477aeb7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:23.029832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13be10cb6d7642f599966a168477aeb7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:23.053022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 886/1792] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:22 2022] DELETE /identity/v3/users/13be10cb6d7642f599966a168477aeb7 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:23.054698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f79c1-04ee-4997-9428-fd17c3ebdcc7 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:23.056061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f79c1-04ee-4997-9428-fd17c3ebdcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:23.056061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f79c1-04ee-4997-9428-fd17c3ebdcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:23.088890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-a87f79c1-04ee-4997-9428-fd17c3ebdcc7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:23.090465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a87f79c1-04ee-4997-9428-fd17c3ebdcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:23.222371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 907/1793] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:23.257721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:23.299174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:23.302908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:23.424780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650cdcb-353d-45b8-9c77-2efee8b9678f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:23.431104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01bd5a-cff7-42c0-9e5f-dbcf3f455eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:23.432100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01bd5a-cff7-42c0-9e5f-dbcf3f455eef service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:23.432611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01bd5a-cff7-42c0-9e5f-dbcf3f455eef service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:23.434011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01bd5a-cff7-42c0-9e5f-dbcf3f455eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:23.465899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01bd5a-cff7-42c0-9e5f-dbcf3f455eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:23.492665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01bd5a-cff7-42c0-9e5f-dbcf3f455eef service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:23.533523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 887/1794] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:23.692444 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:24.220954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f79c1-04ee-4997-9428-fd17c3ebdcc7 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:24.220954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a87f79c1-04ee-4997-9428-fd17c3ebdcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:24.241696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f79c1-04ee-4997-9428-fd17c3ebdcc7 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:24.257785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:24.258725 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:24.259125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:24.259926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] PATH_INFO: `/v3/users/911c3b7e4f424007847effbc6631cdb9` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:24.263375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] RBAC: Authorizing `identity:delete_user(user_id=911c3b7e4f424007847effbc6631cdb9)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:24.274907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:24.538638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:24.565472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911c3b7e4f424007847effbc6631cdb9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:24.567132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911c3b7e4f424007847effbc6631cdb9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:24.678956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911c3b7e4f424007847effbc6631cdb9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:24.680964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911c3b7e4f424007847effbc6631cdb9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:24.728995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911c3b7e4f424007847effbc6631cdb9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:24.796608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 908/1795] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:24 2022] DELETE /identity/v3/users/911c3b7e4f424007847effbc6631cdb9 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:24.798171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17fbf5-353d-412a-9d59-34996711f794 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:24.798734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17fbf5-353d-412a-9d59-34996711f794 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:24.798734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17fbf5-353d-412a-9d59-34996711f794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:24.847505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-5f17fbf5-353d-412a-9d59-34996711f794 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:24.849421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5f17fbf5-353d-412a-9d59-34996711f794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:24.984424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 888/1796] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:25.031337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:25.033307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:25.208492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af056-9af4-4519-ba46-c657fbd182df admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:25.217057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53002643-43a2-4370-a07f-2376e30d7e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:25.217057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53002643-43a2-4370-a07f-2376e30d7e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:25.217057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53002643-43a2-4370-a07f-2376e30d7e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:25.217057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53002643-43a2-4370-a07f-2376e30d7e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:25.251364 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53002643-43a2-4370-a07f-2376e30d7e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:25.256732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53002643-43a2-4370-a07f-2376e30d7e9b service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:25.294558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 909/1797] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:25.534466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17fbf5-353d-412a-9d59-34996711f794 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:25.536847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5f17fbf5-353d-412a-9d59-34996711f794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:25.590528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17fbf5-353d-412a-9d59-34996711f794 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:25.609575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:25.610533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:25.612195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:25.612195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] PATH_INFO: `/v3/projects/80420643fff24265bad0cb9cc4b846ab` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:25.616651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=80420643fff24265bad0cb9cc4b846ab)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:25.618631 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:25.625666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53002643-43a2-4370-a07f-2376e30d7e9b service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:25.627355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-53002643-43a2-4370-a07f-2376e30d7e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:25.858847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53002643-43a2-4370-a07f-2376e30d7e9b service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:25.897259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80420643fff24265bad0cb9cc4b846ab', 'request_id': 'req-a8fda758-69b3-4503-8e30-e6cddcae70fd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:25.919170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80420643fff24265bad0cb9cc4b846ab', 'request_id': 'req-a8fda758-69b3-4503-8e30-e6cddcae70fd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:25.928036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:25.969501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae11c76-5419-4ffc-9bf5-6224a1671a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:25.970587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae11c76-5419-4ffc-9bf5-6224a1671a2b service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:25.970873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae11c76-5419-4ffc-9bf5-6224a1671a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:25.971336 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae11c76-5419-4ffc-9bf5-6224a1671a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:25.974457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4ae11c76-5419-4ffc-9bf5-6224a1671a2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:26.015597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80420643fff24265bad0cb9cc4b846ab', 'request_id': 'req-a8fda758-69b3-4503-8e30-e6cddcae70fd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:26.038644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] The token cache is being invalidate because project 80420643fff24265bad0cb9cc4b846ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:26.039577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:26.041917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a8fda758-69b3-4503-8e30-e6cddcae70fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:26.047410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 889/1798] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:25 2022] DELETE /identity/v3/projects/80420643fff24265bad0cb9cc4b846ab => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:26.055848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c571e-fe69-498a-af08-4abbe4ae4db9 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:26.056738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c571e-fe69-498a-af08-4abbe4ae4db9 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:26.060429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c571e-fe69-498a-af08-4abbe4ae4db9 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:26.060429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 890/1799] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:18:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:18:26.063820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2901622-d187-4061-a663-e1707b284a02 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:26.064474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2901622-d187-4061-a663-e1707b284a02 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:26.065726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2901622-d187-4061-a663-e1707b284a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:26.100434 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d2901622-d187-4061-a663-e1707b284a02 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:26.102244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d2901622-d187-4061-a663-e1707b284a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:26.108394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:26.203132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae11c76-5419-4ffc-9bf5-6224a1671a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:26.205495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae11c76-5419-4ffc-9bf5-6224a1671a2b service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:26.240013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 910/1800] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:26.242291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f283b4-38f7-4d7f-bf80-4abd821bd88b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:26.244261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f283b4-38f7-4d7f-bf80-4abd821bd88b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:26.244765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f283b4-38f7-4d7f-bf80-4abd821bd88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:26.294424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f8f283b4-38f7-4d7f-bf80-4abd821bd88b None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:26.299463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f8f283b4-38f7-4d7f-bf80-4abd821bd88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:26.304866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 891/1801] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:26.313690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07db2f9-9802-4b1c-b494-c5328aa7be57 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:26.314453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07db2f9-9802-4b1c-b494-c5328aa7be57 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:26.314912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07db2f9-9802-4b1c-b494-c5328aa7be57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:26.358689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e07db2f9-9802-4b1c-b494-c5328aa7be57 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:26.360343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e07db2f9-9802-4b1c-b494-c5328aa7be57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:26.372375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 892/1802] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:26.377028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07db2f9-9802-4b1c-b494-c5328aa7be57 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:26.390448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07db2f9-9802-4b1c-b494-c5328aa7be57 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:26.397606 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147ae6-4801-42f3-a9ae-3857ea9e09d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:26.400365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147ae6-4801-42f3-a9ae-3857ea9e09d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:26.400365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147ae6-4801-42f3-a9ae-3857ea9e09d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:26.400365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147ae6-4801-42f3-a9ae-3857ea9e09d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:26.400365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba147ae6-4801-42f3-a9ae-3857ea9e09d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:26.400365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba147ae6-4801-42f3-a9ae-3857ea9e09d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:26.402441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba147ae6-4801-42f3-a9ae-3857ea9e09d3 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:26.416603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 893/1803] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:26.421140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147ae6-4801-42f3-a9ae-3857ea9e09d3 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:26.433737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147ae6-4801-42f3-a9ae-3857ea9e09d3 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:26.441246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1425711-ffc2-4785-b60c-06bfecf68574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:26.446397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1425711-ffc2-4785-b60c-06bfecf68574 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:26.446397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1425711-ffc2-4785-b60c-06bfecf68574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:26.446397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1425711-ffc2-4785-b60c-06bfecf68574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:26.446397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1425711-ffc2-4785-b60c-06bfecf68574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:26.446397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1425711-ffc2-4785-b60c-06bfecf68574 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:26.563591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 911/1804] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:26.594030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 894/1805] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:26 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:26.597973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f283b4-38f7-4d7f-bf80-4abd821bd88b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:26.615108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f283b4-38f7-4d7f-bf80-4abd821bd88b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:26.780682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6562745-a84c-4dcd-bbd1-8d5179c96484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:26.782038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6562745-a84c-4dcd-bbd1-8d5179c96484 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:26.782663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6562745-a84c-4dcd-bbd1-8d5179c96484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:26.786899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6562745-a84c-4dcd-bbd1-8d5179c96484 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:26.786899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6562745-a84c-4dcd-bbd1-8d5179c96484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:26.786899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6562745-a84c-4dcd-bbd1-8d5179c96484 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:26.929411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 912/1806] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:26 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:26.940243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1425711-ffc2-4785-b60c-06bfecf68574 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:26.983090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1425711-ffc2-4785-b60c-06bfecf68574 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:27.005933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd859d9-ada5-464d-a7bd-9a8b6d574e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:27.006842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd859d9-ada5-464d-a7bd-9a8b6d574e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:27.007198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd859d9-ada5-464d-a7bd-9a8b6d574e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:27.007801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd859d9-ada5-464d-a7bd-9a8b6d574e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:27.009177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd859d9-ada5-464d-a7bd-9a8b6d574e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:27.065254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd859d9-ada5-464d-a7bd-9a8b6d574e5b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:27.084660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 895/1807] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:27.084852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6562745-a84c-4dcd-bbd1-8d5179c96484 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:27.101302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6562745-a84c-4dcd-bbd1-8d5179c96484 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:27.108099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c989-faf9-407a-a1a7-7f86b779dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:27.109227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c989-faf9-407a-a1a7-7f86b779dcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:27.109827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c989-faf9-407a-a1a7-7f86b779dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:27.110341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c989-faf9-407a-a1a7-7f86b779dcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:27.113349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8c989-faf9-407a-a1a7-7f86b779dcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:27.116581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8c989-faf9-407a-a1a7-7f86b779dcf8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:27.142269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 913/1808] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:27.149184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd859d9-ada5-464d-a7bd-9a8b6d574e5b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:27.178056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd859d9-ada5-464d-a7bd-9a8b6d574e5b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:27.198675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ad1ff-6a84-4bb8-a400-18369c7f332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:27.199679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad1ff-6a84-4bb8-a400-18369c7f332b admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:27.199961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad1ff-6a84-4bb8-a400-18369c7f332b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:27.205420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad1ff-6a84-4bb8-a400-18369c7f332b admin admin] PATH_INFO: `/v3/projects/e51e8f9361134f009a14e03ca95469e9/users/18824c31a8e849d5a06d07d9adac60bd/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:27.216762 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c989-faf9-407a-a1a7-7f86b779dcf8 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:27.219205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7fd8c989-faf9-407a-a1a7-7f86b779dcf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:27.237382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ad1ff-6a84-4bb8-a400-18369c7f332b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51e8f9361134f009a14e03ca95469e9, user_id=18824c31a8e849d5a06d07d9adac60bd, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:27.241872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ad1ff-6a84-4bb8-a400-18369c7f332b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:27.335799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 896/1809] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:27 2022] PUT /identity/v3/projects/e51e8f9361134f009a14e03ca95469e9/users/18824c31a8e849d5a06d07d9adac60bd/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:27.337631 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ccbae-85a9-4c95-bf8f-a9bcecef1764 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:27.337718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ccbae-85a9-4c95-bf8f-a9bcecef1764 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:27.337991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ccbae-85a9-4c95-bf8f-a9bcecef1764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:27.402543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c989-faf9-407a-a1a7-7f86b779dcf8 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:27.420326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8d4ccbae-85a9-4c95-bf8f-a9bcecef1764 None None] MFA Rules not processed for user `18824c31a8e849d5a06d07d9adac60bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:27.421619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8d4ccbae-85a9-4c95-bf8f-a9bcecef1764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:27.524692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf5db-e543-4da5-860b-54568b313dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:27.525337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf5db-e543-4da5-860b-54568b313dab service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:27.525926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf5db-e543-4da5-860b-54568b313dab service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:27.526207 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf5db-e543-4da5-860b-54568b313dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:27.542745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecf5db-e543-4da5-860b-54568b313dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:27.545320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecf5db-e543-4da5-860b-54568b313dab service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:27.562471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 897/1810] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:27.570721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 914/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:18:27.589215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ccbae-85a9-4c95-bf8f-a9bcecef1764 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:27.589215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8d4ccbae-85a9-4c95-bf8f-a9bcecef1764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:27.778049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ccbae-85a9-4c95-bf8f-a9bcecef1764 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:27.784147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6c516-3b7a-4653-be14-f78c1fd828c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:27.784817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6c516-3b7a-4653-be14-f78c1fd828c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:27.787265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6c516-3b7a-4653-be14-f78c1fd828c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:27.787265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6c516-3b7a-4653-be14-f78c1fd828c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:27.843149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6c516-3b7a-4653-be14-f78c1fd828c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:27.852574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6c516-3b7a-4653-be14-f78c1fd828c8 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:27.863529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 898/1812] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:27.892544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf5db-e543-4da5-860b-54568b313dab service nova] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:27.966471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:28.017836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf5db-e543-4da5-860b-54568b313dab service nova] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:28.040148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:28.041453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:28.041564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:28.044378 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] PATH_INFO: `/v3/users/18824c31a8e849d5a06d07d9adac60bd` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:28.047186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=18824c31a8e849d5a06d07d9adac60bd)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:28.053747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:28.300923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6c516-3b7a-4653-be14-f78c1fd828c8 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:28.304040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-eff6c516-3b7a-4653-be14-f78c1fd828c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:28.339289 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6c516-3b7a-4653-be14-f78c1fd828c8 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:28.361012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18824c31a8e849d5a06d07d9adac60bd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.362262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18824c31a8e849d5a06d07d9adac60bd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.378011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:28.383391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:28.383391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:28.383391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] PATH_INFO: `/v3/projects/73e819bb52e84bedb1f1bcb8f3c83402` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:28.383391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e819bb52e84bedb1f1bcb8f3c83402)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:28.390363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:28.578211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18824c31a8e849d5a06d07d9adac60bd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.579839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18824c31a8e849d5a06d07d9adac60bd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.603220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bced15e-8862-437e-b816-6857864c22ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18824c31a8e849d5a06d07d9adac60bd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.610819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e819bb52e84bedb1f1bcb8f3c83402', 'request_id': 'req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.627814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e819bb52e84bedb1f1bcb8f3c83402', 'request_id': 'req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.651961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 915/1813] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:27 2022] DELETE /identity/v3/users/18824c31a8e849d5a06d07d9adac60bd => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:28.658797 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366fa81-0283-4446-8e32-52fe91c82c1a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:28.659115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366fa81-0283-4446-8e32-52fe91c82c1a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:28.659391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366fa81-0283-4446-8e32-52fe91c82c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:28.690245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4366fa81-0283-4446-8e32-52fe91c82c1a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:28.692755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4366fa81-0283-4446-8e32-52fe91c82c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:28.832164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e819bb52e84bedb1f1bcb8f3c83402', 'request_id': 'req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.850402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 916/1814] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:28.865558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] The token cache is being invalidate because project 73e819bb52e84bedb1f1bcb8f3c83402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:28.868256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.869979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:28.874651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366fa81-0283-4446-8e32-52fe91c82c1a None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:28.875121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 899/1815] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:28 2022] DELETE /identity/v3/projects/73e819bb52e84bedb1f1bcb8f3c83402 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:28.882771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4366fa81-0283-4446-8e32-52fe91c82c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:28.887293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:28.903824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:29.029682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366fa81-0283-4446-8e32-52fe91c82c1a None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:29.039186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:29.042190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:29.042479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:29.043231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:29.046563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:29.065844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58b855-ed07-4d2b-9c7b-c0cc20958ba7 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:29.077024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:29.078001 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:29.078344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:29.080140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] PATH_INFO: `/v3/users/feeb021420fa4bcbb3337165acd43228` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:29.080140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feeb021420fa4bcbb3337165acd43228)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:29.088185 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:29.089886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:29.091332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:29.126594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 917/1816] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:29.246242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:29.338685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feeb021420fa4bcbb3337165acd43228'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:29.397673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:29.426456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feeb021420fa4bcbb3337165acd43228'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:29.440358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feeb021420fa4bcbb3337165acd43228'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:29.442059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feeb021420fa4bcbb3337165acd43228'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:29.458594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feeb021420fa4bcbb3337165acd43228'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:29.463727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 900/1817] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:28 2022] DELETE /identity/v3/users/feeb021420fa4bcbb3337165acd43228 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:29.774724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:29.780237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:29.804508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f26ab-d5c8-46dc-ab7c-69886ea7a686 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:29.965366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:29.966022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:29.966316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:29.966604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] PATH_INFO: `/v3/projects/e51e8f9361134f009a14e03ca95469e9` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:29.974810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51e8f9361134f009a14e03ca95469e9)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:29.977602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:30.116909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:30.120387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:30.143190 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36811684-2ed8-466d-923d-1ecdf3bfe403 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:30.157659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51e8f9361134f009a14e03ca95469e9', 'request_id': 'req-fa3b90df-6793-46de-8aa0-3db4e6b3a158'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.225246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:30.225942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.226223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.226550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] PATH_INFO: `/v3/projects/9b2f8c905619412998f041a1f1b5995b` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.227691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2f8c905619412998f041a1f1b5995b)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:30.229594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:30.234178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51e8f9361134f009a14e03ca95469e9', 'request_id': 'req-fa3b90df-6793-46de-8aa0-3db4e6b3a158'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.241708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51e8f9361134f009a14e03ca95469e9', 'request_id': 'req-fa3b90df-6793-46de-8aa0-3db4e6b3a158'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.253142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] The token cache is being invalidate because project e51e8f9361134f009a14e03ca95469e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:30.253442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.254236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fa3b90df-6793-46de-8aa0-3db4e6b3a158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.260142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 918/1818] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:29 2022] DELETE /identity/v3/projects/e51e8f9361134f009a14e03ca95469e9 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:30.261147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43f408-9850-48f4-b37c-4cbb48a66ff8 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.261527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43f408-9850-48f4-b37c-4cbb48a66ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.261697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43f408-9850-48f4-b37c-4cbb48a66ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.290881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6e43f408-9850-48f4-b37c-4cbb48a66ff8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:30.290881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6e43f408-9850-48f4-b37c-4cbb48a66ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:30.300662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 919/1819] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:30.309956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60bc03-1f3f-4dc6-ad63-506fa5639744 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.310862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60bc03-1f3f-4dc6-ad63-506fa5639744 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.311173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60bc03-1f3f-4dc6-ad63-506fa5639744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.333667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-1b60bc03-1f3f-4dc6-ad63-506fa5639744 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:30.334936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1b60bc03-1f3f-4dc6-ad63-506fa5639744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:30.348646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 920/1820] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:30.352852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60bc03-1f3f-4dc6-ad63-506fa5639744 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:30.365495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60bc03-1f3f-4dc6-ad63-506fa5639744 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:30.386058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2f8c905619412998f041a1f1b5995b', 'request_id': 'req-392b8b44-5a41-4b86-b430-81b6dd63c106'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.417329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2f8c905619412998f041a1f1b5995b', 'request_id': 'req-392b8b44-5a41-4b86-b430-81b6dd63c106'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.460921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789a06e-c2cf-4cce-b7a9-638dbb9c2fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:30.461543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789a06e-c2cf-4cce-b7a9-638dbb9c2fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.461837 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789a06e-c2cf-4cce-b7a9-638dbb9c2fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.462092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789a06e-c2cf-4cce-b7a9-638dbb9c2fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.462744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789a06e-c2cf-4cce-b7a9-638dbb9c2fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:30.463119 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789a06e-c2cf-4cce-b7a9-638dbb9c2fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:30.464930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789a06e-c2cf-4cce-b7a9-638dbb9c2fe9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:30.476773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 921/1821] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:18:30.482293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789a06e-c2cf-4cce-b7a9-638dbb9c2fe9 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:30.492651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789a06e-c2cf-4cce-b7a9-638dbb9c2fe9 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:30.497520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbbb21-c4dd-488b-a1f1-7c520fd7124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:30.498135 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbbb21-c4dd-488b-a1f1-7c520fd7124a admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.498421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbbb21-c4dd-488b-a1f1-7c520fd7124a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.498780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbbb21-c4dd-488b-a1f1-7c520fd7124a admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.499419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbbb21-c4dd-488b-a1f1-7c520fd7124a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:30.501510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbbb21-c4dd-488b-a1f1-7c520fd7124a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:30.508836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2f8c905619412998f041a1f1b5995b', 'request_id': 'req-392b8b44-5a41-4b86-b430-81b6dd63c106'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.529032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] The token cache is being invalidate because project 9b2f8c905619412998f041a1f1b5995b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:30.529492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.530298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392b8b44-5a41-4b86-b430-81b6dd63c106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:30.532024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 901/1822] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:30 2022] DELETE /identity/v3/projects/9b2f8c905619412998f041a1f1b5995b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:30.537176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c15896-ad28-411e-b83f-aa0fce98ec0f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.537646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c15896-ad28-411e-b83f-aa0fce98ec0f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.538059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c15896-ad28-411e-b83f-aa0fce98ec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.558169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-76c15896-ad28-411e-b83f-aa0fce98ec0f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:30.559377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-76c15896-ad28-411e-b83f-aa0fce98ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:30.567872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 902/1823] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:30.575522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e11a6b-4d18-46b6-bda6-2bcd23ef632c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.575834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e11a6b-4d18-46b6-bda6-2bcd23ef632c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.576105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e11a6b-4d18-46b6-bda6-2bcd23ef632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.596546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-c6e11a6b-4d18-46b6-bda6-2bcd23ef632c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:30.597756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c6e11a6b-4d18-46b6-bda6-2bcd23ef632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:30.606189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 903/1824] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:30.610045 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e11a6b-4d18-46b6-bda6-2bcd23ef632c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:30.618437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 922/1825] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:30 2022] POST /identity/v3/projects => generated 357 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:30.622914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e11a6b-4d18-46b6-bda6-2bcd23ef632c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:30.629297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbbb21-c4dd-488b-a1f1-7c520fd7124a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:30.631904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7cfbbb21-c4dd-488b-a1f1-7c520fd7124a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:30.690806 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ec22-80fb-4efa-80dd-2837297d8e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:30.691337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ec22-80fb-4efa-80dd-2837297d8e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.691615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ec22-80fb-4efa-80dd-2837297d8e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.691615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ec22-80fb-4efa-80dd-2837297d8e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.691615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866ec22-80fb-4efa-80dd-2837297d8e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:30.691615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866ec22-80fb-4efa-80dd-2837297d8e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:30.695700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866ec22-80fb-4efa-80dd-2837297d8e0e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:30.711363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 904/1826] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:18:30.713286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ec22-80fb-4efa-80dd-2837297d8e0e admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:30.714380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbbb21-c4dd-488b-a1f1-7c520fd7124a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:30.719121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f17e7-fe58-4393-a132-d46846e4e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:30.719820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f17e7-fe58-4393-a132-d46846e4e070 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.720055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f17e7-fe58-4393-a132-d46846e4e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.720330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f17e7-fe58-4393-a132-d46846e4e070 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.720971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f17e7-fe58-4393-a132-d46846e4e070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:30.722867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f17e7-fe58-4393-a132-d46846e4e070 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:30.725413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ec22-80fb-4efa-80dd-2837297d8e0e admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:30.731322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f655a33-5f26-4ab2-8ba4-acada6774dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:30.732518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f655a33-5f26-4ab2-8ba4-acada6774dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.732518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f655a33-5f26-4ab2-8ba4-acada6774dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.732789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f655a33-5f26-4ab2-8ba4-acada6774dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.733345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f655a33-5f26-4ab2-8ba4-acada6774dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:30.735251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f655a33-5f26-4ab2-8ba4-acada6774dd0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:30.897938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 923/1827] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:30 2022] POST /identity/v3/users => generated 279 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:30.901475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f17e7-fe58-4393-a132-d46846e4e070 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:30.911246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f17e7-fe58-4393-a132-d46846e4e070 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:30.915996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eef114-e9c7-4265-abe6-578656d7ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:30.916612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eef114-e9c7-4265-abe6-578656d7ec85 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:30.916897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eef114-e9c7-4265-abe6-578656d7ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:30.917176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eef114-e9c7-4265-abe6-578656d7ec85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:30.917948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eef114-e9c7-4265-abe6-578656d7ec85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:30.919906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eef114-e9c7-4265-abe6-578656d7ec85 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:30.933700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 924/1828] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:30.934391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 905/1829] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:30 2022] POST /identity/v3/projects => generated 389 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:30.937885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eef114-e9c7-4265-abe6-578656d7ec85 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:30.939538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f655a33-5f26-4ab2-8ba4-acada6774dd0 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:30.948777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eef114-e9c7-4265-abe6-578656d7ec85 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.006706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f655a33-5f26-4ab2-8ba4-acada6774dd0 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.012174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c8507-66e5-4e8b-9adc-9f4531bef7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.012447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c8507-66e5-4e8b-9adc-9f4531bef7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.012666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b5ffe-c409-4737-a83c-89497101d840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.012836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c8507-66e5-4e8b-9adc-9f4531bef7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.013054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c8507-66e5-4e8b-9adc-9f4531bef7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.013342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b5ffe-c409-4737-a83c-89497101d840 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.013528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b5ffe-c409-4737-a83c-89497101d840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.013623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c8507-66e5-4e8b-9adc-9f4531bef7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.013804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b5ffe-c409-4737-a83c-89497101d840 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.014441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b5ffe-c409-4737-a83c-89497101d840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.015237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c8507-66e5-4e8b-9adc-9f4531bef7a7 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.016452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b5ffe-c409-4737-a83c-89497101d840 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.025750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 925/1830] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:31.030151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c8507-66e5-4e8b-9adc-9f4531bef7a7 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:31.040504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c8507-66e5-4e8b-9adc-9f4531bef7a7 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.045178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150772f-5881-4a15-b20f-c0951863232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.046093 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150772f-5881-4a15-b20f-c0951863232e admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.046203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150772f-5881-4a15-b20f-c0951863232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.046397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150772f-5881-4a15-b20f-c0951863232e admin admin] PATH_INFO: `/v3/projects/f73033d76e65414bb5f45d010d332073/users/d4d05d8295dc40d593e1d2afa5a18da4/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.063051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150772f-5881-4a15-b20f-c0951863232e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73033d76e65414bb5f45d010d332073, user_id=d4d05d8295dc40d593e1d2afa5a18da4, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.065950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150772f-5881-4a15-b20f-c0951863232e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.127902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 906/1831] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:30 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:31.132780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b5ffe-c409-4737-a83c-89497101d840 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:31.148503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b5ffe-c409-4737-a83c-89497101d840 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.154922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266a01f-689a-4d09-962d-0f152ecc1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.159323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a01f-689a-4d09-962d-0f152ecc1c10 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.159323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a01f-689a-4d09-962d-0f152ecc1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.159323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a01f-689a-4d09-962d-0f152ecc1c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.159323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266a01f-689a-4d09-962d-0f152ecc1c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.160444 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266a01f-689a-4d09-962d-0f152ecc1c10 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.166678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 926/1832] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:31 2022] PUT /identity/v3/projects/f73033d76e65414bb5f45d010d332073/users/d4d05d8295dc40d593e1d2afa5a18da4/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:31.182918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 907/1833] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:31.184694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b8ca-dde2-4d2b-817c-39ab5b9723fd None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.184828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266a01f-689a-4d09-962d-0f152ecc1c10 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:31.185147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b8ca-dde2-4d2b-817c-39ab5b9723fd None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.185597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b8ca-dde2-4d2b-817c-39ab5b9723fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.200746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266a01f-689a-4d09-962d-0f152ecc1c10 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.225988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2f23b8ca-dde2-4d2b-817c-39ab5b9723fd None None] MFA Rules not processed for user `d4d05d8295dc40d593e1d2afa5a18da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:31.227723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2f23b8ca-dde2-4d2b-817c-39ab5b9723fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:31.274406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae2a09-3322-4992-8400-43da7f8bd1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.275025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae2a09-3322-4992-8400-43da7f8bd1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.275330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae2a09-3322-4992-8400-43da7f8bd1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.275595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae2a09-3322-4992-8400-43da7f8bd1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.276275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae2a09-3322-4992-8400-43da7f8bd1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.277880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae2a09-3322-4992-8400-43da7f8bd1b8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.290051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 908/1834] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:31.295776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae2a09-3322-4992-8400-43da7f8bd1b8 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:31.304210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 927/1835] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:31.307343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae2a09-3322-4992-8400-43da7f8bd1b8 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.314560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa31542-4f8a-4666-8e5c-c6a026f7cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.315172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa31542-4f8a-4666-8e5c-c6a026f7cfac admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.315461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa31542-4f8a-4666-8e5c-c6a026f7cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.315778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa31542-4f8a-4666-8e5c-c6a026f7cfac admin admin] PATH_INFO: `/v3/projects/bd1eb74d5cb5415c8d143757446d7455/users/e158da224cff477f985d86f128b75ef9/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.332565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa31542-4f8a-4666-8e5c-c6a026f7cfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1eb74d5cb5415c8d143757446d7455, user_id=e158da224cff477f985d86f128b75ef9, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.335228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa31542-4f8a-4666-8e5c-c6a026f7cfac admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.341617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23b8ca-dde2-4d2b-817c-39ab5b9723fd None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:31.343036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2f23b8ca-dde2-4d2b-817c-39ab5b9723fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:31.404747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23b8ca-dde2-4d2b-817c-39ab5b9723fd None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.409995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a29ca6-fee2-4de0-9ed3-f722711c2f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.409995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29ca6-fee2-4de0-9ed3-f722711c2f62 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.409995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29ca6-fee2-4de0-9ed3-f722711c2f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.409995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29ca6-fee2-4de0-9ed3-f722711c2f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.419534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a29ca6-fee2-4de0-9ed3-f722711c2f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.421007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a29ca6-fee2-4de0-9ed3-f722711c2f62 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.432482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 928/1836] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:18:31.439411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 909/1837] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:31 2022] PUT /identity/v3/projects/bd1eb74d5cb5415c8d143757446d7455/users/e158da224cff477f985d86f128b75ef9/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:31.444416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069b604-9c25-44ee-87d5-a4b07ffa0ed4 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.444830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069b604-9c25-44ee-87d5-a4b07ffa0ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.445418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069b604-9c25-44ee-87d5-a4b07ffa0ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.453863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa31542-4f8a-4666-8e5c-c6a026f7cfac admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:31.471008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:31.483084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b069b604-9c25-44ee-87d5-a4b07ffa0ed4 None None] MFA Rules not processed for user `e158da224cff477f985d86f128b75ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:31.484359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b069b604-9c25-44ee-87d5-a4b07ffa0ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:31.524409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa31542-4f8a-4666-8e5c-c6a026f7cfac admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.529601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.530507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.530858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.531200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] PATH_INFO: `/v3/users/d4d05d8295dc40d593e1d2afa5a18da4` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.532582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d05d8295dc40d593e1d2afa5a18da4)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.534820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.558330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 929/1838] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:31.562436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069b604-9c25-44ee-87d5-a4b07ffa0ed4 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:31.573526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069b604-9c25-44ee-87d5-a4b07ffa0ed4 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.578536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30cad3-eca9-4aae-9d65-5e8b9ff3a1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.579145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30cad3-eca9-4aae-9d65-5e8b9ff3a1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.579432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30cad3-eca9-4aae-9d65-5e8b9ff3a1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.579783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30cad3-eca9-4aae-9d65-5e8b9ff3a1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.580465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30cad3-eca9-4aae-9d65-5e8b9ff3a1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.582665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30cad3-eca9-4aae-9d65-5e8b9ff3a1e6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.747892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 930/1839] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:31 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:31.749039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30cad3-eca9-4aae-9d65-5e8b9ff3a1e6 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:31.786804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d05d8295dc40d593e1d2afa5a18da4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:31.826828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30cad3-eca9-4aae-9d65-5e8b9ff3a1e6 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.826828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e7f3f-353c-4776-9dcc-b26ea5f0c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.826828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e7f3f-353c-4776-9dcc-b26ea5f0c69d admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.826828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e7f3f-353c-4776-9dcc-b26ea5f0c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.827471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e7f3f-353c-4776-9dcc-b26ea5f0c69d admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.827471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e7f3f-353c-4776-9dcc-b26ea5f0c69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.828351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e7f3f-353c-4776-9dcc-b26ea5f0c69d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.925932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d05d8295dc40d593e1d2afa5a18da4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:31.945322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d05d8295dc40d593e1d2afa5a18da4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:31.947196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d05d8295dc40d593e1d2afa5a18da4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:31.953228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 931/1840] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:31 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:31.955054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e7f3f-353c-4776-9dcc-b26ea5f0c69d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:31.957048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c71e7f3f-353c-4776-9dcc-b26ea5f0c69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:31.967304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6b8d0dcc-6696-48d1-b0ff-ded337edb5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d05d8295dc40d593e1d2afa5a18da4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:31.971694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e7f3f-353c-4776-9dcc-b26ea5f0c69d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:31.978885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:31.979554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f9ccd-6962-464c-8417-0f4ab73d057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:31.980293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f9ccd-6962-464c-8417-0f4ab73d057f admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.980574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f9ccd-6962-464c-8417-0f4ab73d057f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.980894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f9ccd-6962-464c-8417-0f4ab73d057f admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:31.982390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 910/1841] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:31 2022] DELETE /identity/v3/users/d4d05d8295dc40d593e1d2afa5a18da4 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:31.982535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f9ccd-6962-464c-8417-0f4ab73d057f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:31.984015 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f9ccd-6962-464c-8417-0f4ab73d057f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:31.988508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee408e-0c49-4d7b-baa7-c0dcc317cc70 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:31.988973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee408e-0c49-4d7b-baa7-c0dcc317cc70 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:31.989300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee408e-0c49-4d7b-baa7-c0dcc317cc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:32.001551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 932/1842] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:32.010620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f9ccd-6962-464c-8417-0f4ab73d057f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:32.027121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f9ccd-6962-464c-8417-0f4ab73d057f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:32.035826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8eee408e-0c49-4d7b-baa7-c0dcc317cc70 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:32.037060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8eee408e-0c49-4d7b-baa7-c0dcc317cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:32.115559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b6db4-349e-4f98-b1a6-3383122bcb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:32.116379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b6db4-349e-4f98-b1a6-3383122bcb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:32.116665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b6db4-349e-4f98-b1a6-3383122bcb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:32.116946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b6db4-349e-4f98-b1a6-3383122bcb7a admin admin] PATH_INFO: `/v3/projects/34d28478e1614e63a7f743150c11d4ad/users/b9de9966036d4abfb2da8529dcf7c208/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:32.141348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b6db4-349e-4f98-b1a6-3383122bcb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d28478e1614e63a7f743150c11d4ad, user_id=b9de9966036d4abfb2da8529dcf7c208, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:32.144212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b6db4-349e-4f98-b1a6-3383122bcb7a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:32.156540 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 911/1843] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:32.176310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee408e-0c49-4d7b-baa7-c0dcc317cc70 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:32.179728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8eee408e-0c49-4d7b-baa7-c0dcc317cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:32.253043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 933/1844] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:32 2022] PUT /identity/v3/projects/34d28478e1614e63a7f743150c11d4ad/users/b9de9966036d4abfb2da8529dcf7c208/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:32.264878 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b6db4-349e-4f98-b1a6-3383122bcb7a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:32.267853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee408e-0c49-4d7b-baa7-c0dcc317cc70 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:32.326298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68229318-cb8b-4c73-b3ff-95015b250295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:32.326922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68229318-cb8b-4c73-b3ff-95015b250295 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:32.327651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68229318-cb8b-4c73-b3ff-95015b250295 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:32.327841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68229318-cb8b-4c73-b3ff-95015b250295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:32.331428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b6db4-349e-4f98-b1a6-3383122bcb7a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:32.338419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174460c-02ef-4df6-85ce-4e1dc2cf1097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:32.339098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68229318-cb8b-4c73-b3ff-95015b250295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:32.339581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174460c-02ef-4df6-85ce-4e1dc2cf1097 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:32.344721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174460c-02ef-4df6-85ce-4e1dc2cf1097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:32.344721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174460c-02ef-4df6-85ce-4e1dc2cf1097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:32.344894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68229318-cb8b-4c73-b3ff-95015b250295 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:32.344983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174460c-02ef-4df6-85ce-4e1dc2cf1097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:32.344983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174460c-02ef-4df6-85ce-4e1dc2cf1097 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:32.351942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 912/1845] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:18:32.354511 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 934/1846] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:32.359055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68229318-cb8b-4c73-b3ff-95015b250295 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:32.373637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68229318-cb8b-4c73-b3ff-95015b250295 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:32.377013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387168-6a95-4090-943f-b41fd2e359bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:32.377801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387168-6a95-4090-943f-b41fd2e359bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:32.377994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387168-6a95-4090-943f-b41fd2e359bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:32.378431 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387168-6a95-4090-943f-b41fd2e359bf admin admin] PATH_INFO: `/v3/projects/34d28478e1614e63a7f743150c11d4ad/users/b9de9966036d4abfb2da8529dcf7c208/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:32.381693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88387168-6a95-4090-943f-b41fd2e359bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d28478e1614e63a7f743150c11d4ad, user_id=b9de9966036d4abfb2da8529dcf7c208, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:32.384410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88387168-6a95-4090-943f-b41fd2e359bf admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:32.397780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 913/1847] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:32 2022] PUT /identity/v3/projects/34d28478e1614e63a7f743150c11d4ad/users/b9de9966036d4abfb2da8529dcf7c208/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:32.409602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08ebc9-8297-4f8c-9acd-0650ba324224 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:32.412970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08ebc9-8297-4f8c-9acd-0650ba324224 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:32.412970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08ebc9-8297-4f8c-9acd-0650ba324224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:32.450571 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9f08ebc9-8297-4f8c-9acd-0650ba324224 None None] MFA Rules not processed for user `b9de9966036d4abfb2da8529dcf7c208`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:32.451952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9f08ebc9-8297-4f8c-9acd-0650ba324224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:32.528553 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 935/1848] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:32.541778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387168-6a95-4090-943f-b41fd2e359bf admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:32.543819 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-88387168-6a95-4090-943f-b41fd2e359bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:32.637446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387168-6a95-4090-943f-b41fd2e359bf admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:32.641613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fdcdf-d002-48b5-99f9-d486018d9d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:32.642353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fdcdf-d002-48b5-99f9-d486018d9d58 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:32.642581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fdcdf-d002-48b5-99f9-d486018d9d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:32.646670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fdcdf-d002-48b5-99f9-d486018d9d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:32.653006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fdcdf-d002-48b5-99f9-d486018d9d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:32.654557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fdcdf-d002-48b5-99f9-d486018d9d58 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:32.669580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 914/1849] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:32.715519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:32.802744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08ebc9-8297-4f8c-9acd-0650ba324224 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:32.804423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9f08ebc9-8297-4f8c-9acd-0650ba324224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:32.814929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fdcdf-d002-48b5-99f9-d486018d9d58 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:32.888065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fdcdf-d002-48b5-99f9-d486018d9d58 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:32.888926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08ebc9-8297-4f8c-9acd-0650ba324224 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:32.893459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:32.894236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:32.894519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:32.894791 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] PATH_INFO: `/v3/users/e158da224cff477f985d86f128b75ef9` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:32.895846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:32.896494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:32.896776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:32.897048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] PATH_INFO: `/v3/projects/f73033d76e65414bb5f45d010d332073` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:32.898211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73033d76e65414bb5f45d010d332073)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:32.898963 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e158da224cff477f985d86f128b75ef9)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:32.900140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:32.901258 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:33.101532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e158da224cff477f985d86f128b75ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.104451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73033d76e65414bb5f45d010d332073', 'request_id': 'req-0d03e1da-7e42-43b4-b049-5d6176a21039'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.177812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e158da224cff477f985d86f128b75ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.191605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e158da224cff477f985d86f128b75ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.192451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e158da224cff477f985d86f128b75ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.200710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7a2546af-9e99-4b54-89b0-040fc01ae456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e158da224cff477f985d86f128b75ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.226605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 915/1850] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:32 2022] DELETE /identity/v3/users/e158da224cff477f985d86f128b75ef9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:33.228230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15026d5a-d228-4f56-adb0-ef172d3d3dcf None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:33.229446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15026d5a-d228-4f56-adb0-ef172d3d3dcf None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:33.229802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15026d5a-d228-4f56-adb0-ef172d3d3dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:33.259142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-15026d5a-d228-4f56-adb0-ef172d3d3dcf None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:33.260445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-15026d5a-d228-4f56-adb0-ef172d3d3dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:33.274359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73033d76e65414bb5f45d010d332073', 'request_id': 'req-0d03e1da-7e42-43b4-b049-5d6176a21039'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.281718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73033d76e65414bb5f45d010d332073', 'request_id': 'req-0d03e1da-7e42-43b4-b049-5d6176a21039'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.303819 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] The token cache is being invalidate because project f73033d76e65414bb5f45d010d332073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:33.304205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.306585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0d03e1da-7e42-43b4-b049-5d6176a21039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:33.308379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 936/1851] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:32 2022] DELETE /identity/v3/projects/f73033d76e65414bb5f45d010d332073 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:33.313000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daff613-cc30-43c5-9470-16b15378a8e0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:33.313286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daff613-cc30-43c5-9470-16b15378a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:33.313560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daff613-cc30-43c5-9470-16b15378a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:33.367942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5daff613-cc30-43c5-9470-16b15378a8e0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:33.369166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5daff613-cc30-43c5-9470-16b15378a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:33.411573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 916/1852] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:33.447866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15026d5a-d228-4f56-adb0-ef172d3d3dcf None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:33.450278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-15026d5a-d228-4f56-adb0-ef172d3d3dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:33.535510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 937/1853] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:33.543266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc6a85-a6ff-4b3a-9f83-c6feec396f58 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:33.543899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc6a85-a6ff-4b3a-9f83-c6feec396f58 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:33.544309 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc6a85-a6ff-4b3a-9f83-c6feec396f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:33.582528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-27cc6a85-a6ff-4b3a-9f83-c6feec396f58 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:33.584369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-27cc6a85-a6ff-4b3a-9f83-c6feec396f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:33.589329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:33.608131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 938/1854] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:33.612237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc6a85-a6ff-4b3a-9f83-c6feec396f58 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:33.627666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc6a85-a6ff-4b3a-9f83-c6feec396f58 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:33.638507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012700-f37c-401f-8544-33905e9ba197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:33.639330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012700-f37c-401f-8544-33905e9ba197 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:33.639887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012700-f37c-401f-8544-33905e9ba197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:33.640354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012700-f37c-401f-8544-33905e9ba197 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:33.641103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39012700-f37c-401f-8544-33905e9ba197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:33.641516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39012700-f37c-401f-8544-33905e9ba197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:33.642759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15026d5a-d228-4f56-adb0-ef172d3d3dcf None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:33.643660 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39012700-f37c-401f-8544-33905e9ba197 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:33.648774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd2f40-52a7-4b0e-a740-c3f78637c01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:33.649634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2f40-52a7-4b0e-a740-c3f78637c01c service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:33.650075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2f40-52a7-4b0e-a740-c3f78637c01c service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:33.650835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2f40-52a7-4b0e-a740-c3f78637c01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:33.662880 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 939/1855] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:18:33.663842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012700-f37c-401f-8544-33905e9ba197 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:33.665608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd2f40-52a7-4b0e-a740-c3f78637c01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:33.668540 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd2f40-52a7-4b0e-a740-c3f78637c01c service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:33.678991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012700-f37c-401f-8544-33905e9ba197 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:33.682755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 917/1856] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:33.684799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0062ac-8237-4580-8bff-2e2cf7ae91d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:33.685432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0062ac-8237-4580-8bff-2e2cf7ae91d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:33.685876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0062ac-8237-4580-8bff-2e2cf7ae91d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:33.686162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0062ac-8237-4580-8bff-2e2cf7ae91d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:33.686834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0062ac-8237-4580-8bff-2e2cf7ae91d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:33.688956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0062ac-8237-4580-8bff-2e2cf7ae91d7 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:33.896122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 940/1857] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:33 2022] POST /identity/v3/projects => generated 367 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:33.900397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd2f40-52a7-4b0e-a740-c3f78637c01c service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:33.912241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd2f40-52a7-4b0e-a740-c3f78637c01c service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:34.034922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ef09a-420f-4d94-93bf-b7e2d148a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:34.035567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ef09a-420f-4d94-93bf-b7e2d148a822 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:34.041125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ef09a-420f-4d94-93bf-b7e2d148a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:34.041125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ef09a-420f-4d94-93bf-b7e2d148a822 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:34.041125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ef09a-420f-4d94-93bf-b7e2d148a822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:34.050821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ef09a-420f-4d94-93bf-b7e2d148a822 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:34.264836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 918/1858] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:33 2022] POST /identity/v3/users => generated 284 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:34.268452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0062ac-8237-4580-8bff-2e2cf7ae91d7 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:34.287348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0062ac-8237-4580-8bff-2e2cf7ae91d7 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:34.296306 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fce6bf-a41b-4126-a908-21fbf7d767f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:34.297120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fce6bf-a41b-4126-a908-21fbf7d767f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:34.297411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fce6bf-a41b-4126-a908-21fbf7d767f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:34.297832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fce6bf-a41b-4126-a908-21fbf7d767f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:34.299576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fce6bf-a41b-4126-a908-21fbf7d767f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:34.301234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fce6bf-a41b-4126-a908-21fbf7d767f3 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:34.335141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 941/1859] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:34.339756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ef09a-420f-4d94-93bf-b7e2d148a822 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:34.352853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ef09a-420f-4d94-93bf-b7e2d148a822 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:34.360357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bc4df-4734-48fc-96c6-e81cad12b3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:34.361216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc4df-4734-48fc-96c6-e81cad12b3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:34.361661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc4df-4734-48fc-96c6-e81cad12b3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:34.362047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc4df-4734-48fc-96c6-e81cad12b3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:34.362707 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bc4df-4734-48fc-96c6-e81cad12b3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:34.366218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bc4df-4734-48fc-96c6-e81cad12b3c1 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:34.378078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 919/1860] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:34.383610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fce6bf-a41b-4126-a908-21fbf7d767f3 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:34.397848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fce6bf-a41b-4126-a908-21fbf7d767f3 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:34.403596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4434265-b2e3-4d17-b81a-dc9bb1c1e2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:34.404555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4434265-b2e3-4d17-b81a-dc9bb1c1e2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:34.414807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4434265-b2e3-4d17-b81a-dc9bb1c1e2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:34.414807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4434265-b2e3-4d17-b81a-dc9bb1c1e2cf admin admin] PATH_INFO: `/v3/projects/dbb5a97cc7de41a5ab6da8a9a2baab2b/users/9af76efc7fc046e09c76870fbc1573cb/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:34.419759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bc4df-4734-48fc-96c6-e81cad12b3c1 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:34.425842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-361bc4df-4734-48fc-96c6-e81cad12b3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:34.455079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bc4df-4734-48fc-96c6-e81cad12b3c1 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:34.464341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:34.465150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:34.465563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:34.466072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] PATH_INFO: `/v3/projects/bd1eb74d5cb5415c8d143757446d7455` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:34.467691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1eb74d5cb5415c8d143757446d7455)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:34.467903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4434265-b2e3-4d17-b81a-dc9bb1c1e2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb5a97cc7de41a5ab6da8a9a2baab2b, user_id=9af76efc7fc046e09c76870fbc1573cb, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:34.470754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4434265-b2e3-4d17-b81a-dc9bb1c1e2cf admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:34.484636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:34.587736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 942/1861] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:34 2022] PUT /identity/v3/projects/dbb5a97cc7de41a5ab6da8a9a2baab2b/users/9af76efc7fc046e09c76870fbc1573cb/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:34.602810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c425946-9620-48bc-8153-f91597a34aff None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:34.603386 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c425946-9620-48bc-8153-f91597a34aff None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:34.603785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c425946-9620-48bc-8153-f91597a34aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:34.634369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1eb74d5cb5415c8d143757446d7455', 'request_id': 'req-08075a8b-2640-4f42-8197-123fe1be8bcf'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:34.635295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-7c425946-9620-48bc-8153-f91597a34aff None None] MFA Rules not processed for user `9af76efc7fc046e09c76870fbc1573cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:34.636547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7c425946-9620-48bc-8153-f91597a34aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:34.643061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1eb74d5cb5415c8d143757446d7455', 'request_id': 'req-08075a8b-2640-4f42-8197-123fe1be8bcf'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:34.718193 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 943/1862] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:34.732966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c425946-9620-48bc-8153-f91597a34aff None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:34.734311 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7c425946-9620-48bc-8153-f91597a34aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:34.756000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1eb74d5cb5415c8d143757446d7455', 'request_id': 'req-08075a8b-2640-4f42-8197-123fe1be8bcf'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:34.769192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] The token cache is being invalidate because project bd1eb74d5cb5415c8d143757446d7455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:34.769755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:34.770983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:34.772565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 920/1863] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:34 2022] DELETE /identity/v3/projects/bd1eb74d5cb5415c8d143757446d7455 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:34.777073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:34.778627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:34.817989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c425946-9620-48bc-8153-f91597a34aff None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:34.821872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37934a-3990-4aa9-a781-54eb1e25ffd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'decb5421872c4034bbbaa8c3cd9dcb5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:34.822539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37934a-3990-4aa9-a781-54eb1e25ffd9 service glance] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:34.822823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37934a-3990-4aa9-a781-54eb1e25ffd9 service glance] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:34.823105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37934a-3990-4aa9-a781-54eb1e25ffd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:34.828833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cb37934a-3990-4aa9-a781-54eb1e25ffd9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:34.837817 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37934a-3990-4aa9-a781-54eb1e25ffd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:34.839650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37934a-3990-4aa9-a781-54eb1e25ffd9 service glance] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:34.850673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 944/1864] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:18:34.853336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075a8b-2640-4f42-8197-123fe1be8bcf admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:34.858493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:34.859174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:34.859460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:34.859940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] PATH_INFO: `/v3/users/b9de9966036d4abfb2da8529dcf7c208` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:34.861140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9de9966036d4abfb2da8529dcf7c208)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:34.863146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:34.949162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:35.132855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9de9966036d4abfb2da8529dcf7c208'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:35.222767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9de9966036d4abfb2da8529dcf7c208'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:35.236995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9de9966036d4abfb2da8529dcf7c208'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:35.237731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9de9966036d4abfb2da8529dcf7c208'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:35.245296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb6cf9ec-d39f-48e9-a454-a2533b974b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9de9966036d4abfb2da8529dcf7c208'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:35.255818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 921/1865] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:34 2022] DELETE /identity/v3/users/b9de9966036d4abfb2da8529dcf7c208 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:35.825408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37934a-3990-4aa9-a781-54eb1e25ffd9 service glance] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:35.848935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37934a-3990-4aa9-a781-54eb1e25ffd9 service glance] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:35.857256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d759f-7820-4830-a013-1f878e5ab61f None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:35.859659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d759f-7820-4830-a013-1f878e5ab61f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:35.861085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d759f-7820-4830-a013-1f878e5ab61f None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:35.863964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 922/1866] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:18:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:18:35.897055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeb2ae-1d0b-4bb5-9c23-c1a40cb9e363 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:35.898043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeb2ae-1d0b-4bb5-9c23-c1a40cb9e363 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:35.898571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeb2ae-1d0b-4bb5-9c23-c1a40cb9e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:35.942286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-bffeb2ae-1d0b-4bb5-9c23-c1a40cb9e363 None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:35.942286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bffeb2ae-1d0b-4bb5-9c23-c1a40cb9e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:35.959533 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:35.960535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:35.964723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:35.964723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] PATH_INFO: `/v3/projects/34d28478e1614e63a7f743150c11d4ad` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:35.964723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d28478e1614e63a7f743150c11d4ad)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:35.966390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:36.039171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 923/1867] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:18:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:36.068406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeb2ae-1d0b-4bb5-9c23-c1a40cb9e363 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:36.071476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bffeb2ae-1d0b-4bb5-9c23-c1a40cb9e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:36.090341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeb2ae-1d0b-4bb5-9c23-c1a40cb9e363 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:36.108628 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d28478e1614e63a7f743150c11d4ad', 'request_id': 'req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:36.134418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:36.186408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1ff3a-4f2c-4351-884f-6f20f6bb9a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:36.187375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1ff3a-4f2c-4351-884f-6f20f6bb9a94 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:36.187882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1ff3a-4f2c-4351-884f-6f20f6bb9a94 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:36.188439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1ff3a-4f2c-4351-884f-6f20f6bb9a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:36.211939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d28478e1614e63a7f743150c11d4ad', 'request_id': 'req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:36.212986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1ff3a-4f2c-4351-884f-6f20f6bb9a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:36.215421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1ff3a-4f2c-4351-884f-6f20f6bb9a94 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:36.229167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d28478e1614e63a7f743150c11d4ad', 'request_id': 'req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:36.232533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 924/1868] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:18:36.257753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] The token cache is being invalidate because project 34d28478e1614e63a7f743150c11d4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:36.258923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:36.260928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8ef8fc2d-60c9-4d1b-8a8b-d82c55f0519f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:36.262810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 945/1869] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:35 2022] DELETE /identity/v3/projects/34d28478e1614e63a7f743150c11d4ad => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:36.269827 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9d7f2-5a40-4c87-8b46-422c5ae0c56c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:36.271012 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9d7f2-5a40-4c87-8b46-422c5ae0c56c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:36.271396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9d7f2-5a40-4c87-8b46-422c5ae0c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:36.294281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a4f9d7f2-5a40-4c87-8b46-422c5ae0c56c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:36.295123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a4f9d7f2-5a40-4c87-8b46-422c5ae0c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:36.381516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 925/1870] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:36.397994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c62a3-8544-4bf4-97f0-5216218c4285 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:36.398859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c62a3-8544-4bf4-97f0-5216218c4285 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:36.399471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c62a3-8544-4bf4-97f0-5216218c4285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:36.434289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-738c62a3-8544-4bf4-97f0-5216218c4285 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:36.435979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-738c62a3-8544-4bf4-97f0-5216218c4285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:36.477561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 946/1871] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:36.479590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9d7f2-5a40-4c87-8b46-422c5ae0c56c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:36.493989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9d7f2-5a40-4c87-8b46-422c5ae0c56c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:36.500990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92043bff-6c5e-47b5-97ac-93e34e721e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:36.501845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92043bff-6c5e-47b5-97ac-93e34e721e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:36.502249 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92043bff-6c5e-47b5-97ac-93e34e721e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:36.503016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92043bff-6c5e-47b5-97ac-93e34e721e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:36.503824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92043bff-6c5e-47b5-97ac-93e34e721e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:36.504191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92043bff-6c5e-47b5-97ac-93e34e721e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:36.506458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92043bff-6c5e-47b5-97ac-93e34e721e8e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:36.527846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c62a3-8544-4bf4-97f0-5216218c4285 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:36.535071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 926/1872] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:36.540741 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c62a3-8544-4bf4-97f0-5216218c4285 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:36.546507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1ced1-7433-4ea0-8b34-48df58d6ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:36.547582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1ced1-7433-4ea0-8b34-48df58d6ee83 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:36.548153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1ced1-7433-4ea0-8b34-48df58d6ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:36.548805 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1ced1-7433-4ea0-8b34-48df58d6ee83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:36.549718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1ced1-7433-4ea0-8b34-48df58d6ee83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:36.552050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1ced1-7433-4ea0-8b34-48df58d6ee83 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:36.715954 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92043bff-6c5e-47b5-97ac-93e34e721e8e admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:36.717347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 947/1873] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:36 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:36.732089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92043bff-6c5e-47b5-97ac-93e34e721e8e admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:36.820107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d931ed-8f1e-4784-b650-1399ddacfbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:36.822738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d931ed-8f1e-4784-b650-1399ddacfbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:36.822738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d931ed-8f1e-4784-b650-1399ddacfbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:36.822738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d931ed-8f1e-4784-b650-1399ddacfbc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:36.822738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d931ed-8f1e-4784-b650-1399ddacfbc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:36.827159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d931ed-8f1e-4784-b650-1399ddacfbc8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:36.911548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1ced1-7433-4ea0-8b34-48df58d6ee83 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:36.912103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 927/1874] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:36 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:36.932991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1ced1-7433-4ea0-8b34-48df58d6ee83 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:36.962260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11c20-0647-4393-b384-ec6456c4f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:36.962981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11c20-0647-4393-b384-ec6456c4f3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:36.965000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11c20-0647-4393-b384-ec6456c4f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:36.965461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11c20-0647-4393-b384-ec6456c4f3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:36.966343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11c20-0647-4393-b384-ec6456c4f3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:36.973303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11c20-0647-4393-b384-ec6456c4f3c8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:36.998246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d931ed-8f1e-4784-b650-1399ddacfbc8 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:36.998648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 948/1875] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:37.012882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d931ed-8f1e-4784-b650-1399ddacfbc8 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:37.032959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f2e7d-e1b2-4874-ae5c-d8bdc1f15c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:37.033683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f2e7d-e1b2-4874-ae5c-d8bdc1f15c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:37.034043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f2e7d-e1b2-4874-ae5c-d8bdc1f15c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:37.034397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f2e7d-e1b2-4874-ae5c-d8bdc1f15c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:37.035159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f2e7d-e1b2-4874-ae5c-d8bdc1f15c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:37.037455 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f2e7d-e1b2-4874-ae5c-d8bdc1f15c6b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:37.052741 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 928/1876] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:37.056410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11c20-0647-4393-b384-ec6456c4f3c8 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:37.068470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11c20-0647-4393-b384-ec6456c4f3c8 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:37.076055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d987-b891-482c-8710-fd5137bf66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:37.076821 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d987-b891-482c-8710-fd5137bf66e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:37.077991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d987-b891-482c-8710-fd5137bf66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:37.078506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d987-b891-482c-8710-fd5137bf66e5 admin admin] PATH_INFO: `/v3/projects/eb0d2b23630f4a6ebee63c20ffab828c/users/4c6ef9411fb643df8ed0414a1f92e0b0/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:37.103165 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6d987-b891-482c-8710-fd5137bf66e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0d2b23630f4a6ebee63c20ffab828c, user_id=4c6ef9411fb643df8ed0414a1f92e0b0, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:37.106066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6d987-b891-482c-8710-fd5137bf66e5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:37.247815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 949/1877] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:37 2022] PUT /identity/v3/projects/eb0d2b23630f4a6ebee63c20ffab828c/users/4c6ef9411fb643df8ed0414a1f92e0b0/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:37.248949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce11f0c-2d80-47cd-ab3c-89e8bf11a46a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:37.249239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce11f0c-2d80-47cd-ab3c-89e8bf11a46a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:37.249518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce11f0c-2d80-47cd-ab3c-89e8bf11a46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:37.284610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-cce11f0c-2d80-47cd-ab3c-89e8bf11a46a None None] MFA Rules not processed for user `4c6ef9411fb643df8ed0414a1f92e0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:37.286686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cce11f0c-2d80-47cd-ab3c-89e8bf11a46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:37.367468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 929/1878] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:37.371779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d987-b891-482c-8710-fd5137bf66e5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:37.431935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:37.485673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d987-b891-482c-8710-fd5137bf66e5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:37.490847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a366a24-439a-41a3-9595-29a9bd55aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:37.491540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a366a24-439a-41a3-9595-29a9bd55aaf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:37.492223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a366a24-439a-41a3-9595-29a9bd55aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:37.492483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a366a24-439a-41a3-9595-29a9bd55aaf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:37.493250 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a366a24-439a-41a3-9595-29a9bd55aaf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:37.495264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a366a24-439a-41a3-9595-29a9bd55aaf5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:37.573958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 950/1879] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:37 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:37.578201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce11f0c-2d80-47cd-ab3c-89e8bf11a46a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:37.590713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce11f0c-2d80-47cd-ab3c-89e8bf11a46a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:37.667188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb9354-c4b6-4fd3-90de-acf0c9a753a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:37.667989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb9354-c4b6-4fd3-90de-acf0c9a753a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:37.668350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb9354-c4b6-4fd3-90de-acf0c9a753a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:37.669005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb9354-c4b6-4fd3-90de-acf0c9a753a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:37.669502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb9354-c4b6-4fd3-90de-acf0c9a753a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:37.672438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb9354-c4b6-4fd3-90de-acf0c9a753a8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:37.795262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 930/1880] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:37 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:37.799504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a366a24-439a-41a3-9595-29a9bd55aaf5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:37.812376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a366a24-439a-41a3-9595-29a9bd55aaf5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:37.818352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f719f-1a65-4fff-8af3-d580060766c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:37.818636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f719f-1a65-4fff-8af3-d580060766c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:37.819002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f719f-1a65-4fff-8af3-d580060766c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:37.819451 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f719f-1a65-4fff-8af3-d580060766c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:37.820213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f719f-1a65-4fff-8af3-d580060766c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:37.821815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f719f-1a65-4fff-8af3-d580060766c3 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:37.840857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb9354-c4b6-4fd3-90de-acf0c9a753a8 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:37.842080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 951/1881] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:37.858283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb9354-c4b6-4fd3-90de-acf0c9a753a8 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:37.864051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7c3e3-9ac2-49c0-9425-9ad62d4e5f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:37.865188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7c3e3-9ac2-49c0-9425-9ad62d4e5f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:37.865623 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7c3e3-9ac2-49c0-9425-9ad62d4e5f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:37.865911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7c3e3-9ac2-49c0-9425-9ad62d4e5f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:37.866560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7c3e3-9ac2-49c0-9425-9ad62d4e5f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:37.868301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7c3e3-9ac2-49c0-9425-9ad62d4e5f55 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:37.890605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 931/1882] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:37.892896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f719f-1a65-4fff-8af3-d580060766c3 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:37.904523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f719f-1a65-4fff-8af3-d580060766c3 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:37.920184 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b259-37ce-4176-87b4-2ad8952fdba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:37.920779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b259-37ce-4176-87b4-2ad8952fdba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:37.924742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b259-37ce-4176-87b4-2ad8952fdba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:37.925067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b259-37ce-4176-87b4-2ad8952fdba8 admin admin] PATH_INFO: `/v3/projects/39bef1bdab454a2cbcdab8d7842b867c/users/e810d010dc7244078a0f628d3018da2f/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:37.951121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263b259-37ce-4176-87b4-2ad8952fdba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39bef1bdab454a2cbcdab8d7842b867c, user_id=e810d010dc7244078a0f628d3018da2f, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:37.956284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263b259-37ce-4176-87b4-2ad8952fdba8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:38.047681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 952/1883] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:37 2022] PUT /identity/v3/projects/39bef1bdab454a2cbcdab8d7842b867c/users/e810d010dc7244078a0f628d3018da2f/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:38.054890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34f31-e5ee-4dbd-90c7-5c677b4321ad None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:38.055474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34f31-e5ee-4dbd-90c7-5c677b4321ad None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:38.055474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34f31-e5ee-4dbd-90c7-5c677b4321ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:38.131122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-70f34f31-e5ee-4dbd-90c7-5c677b4321ad None None] MFA Rules not processed for user `e810d010dc7244078a0f628d3018da2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:38.132414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-70f34f31-e5ee-4dbd-90c7-5c677b4321ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:38.229746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 932/1884] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:38.240095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b259-37ce-4176-87b4-2ad8952fdba8 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:38.316409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b259-37ce-4176-87b4-2ad8952fdba8 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:38.323525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141266-8bc0-4217-aca8-21606bf4cc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:38.323765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141266-8bc0-4217-aca8-21606bf4cc01 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:38.324678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141266-8bc0-4217-aca8-21606bf4cc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:38.324678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141266-8bc0-4217-aca8-21606bf4cc01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:38.324949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141266-8bc0-4217-aca8-21606bf4cc01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:38.326983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141266-8bc0-4217-aca8-21606bf4cc01 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:38.436912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 953/1885] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:38 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:38.442222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34f31-e5ee-4dbd-90c7-5c677b4321ad None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:38.458221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34f31-e5ee-4dbd-90c7-5c677b4321ad None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:38.534736 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5015f-49ea-497e-a7e8-66f0048be9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:38.535724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5015f-49ea-497e-a7e8-66f0048be9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:38.536278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5015f-49ea-497e-a7e8-66f0048be9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:38.536846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5015f-49ea-497e-a7e8-66f0048be9e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:38.537708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5015f-49ea-497e-a7e8-66f0048be9e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:38.541406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5015f-49ea-497e-a7e8-66f0048be9e0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:38.662978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 933/1886] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:38 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:38.667100 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141266-8bc0-4217-aca8-21606bf4cc01 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:38.677383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141266-8bc0-4217-aca8-21606bf4cc01 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:38.682281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c74ca-698a-4adf-992b-77fefaa3652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:38.682896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c74ca-698a-4adf-992b-77fefaa3652e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:38.683178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c74ca-698a-4adf-992b-77fefaa3652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:38.683648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c74ca-698a-4adf-992b-77fefaa3652e admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:38.684418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c74ca-698a-4adf-992b-77fefaa3652e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:38.686007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c74ca-698a-4adf-992b-77fefaa3652e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:38.697656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 954/1887] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:38.702023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5015f-49ea-497e-a7e8-66f0048be9e0 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:38.725243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5015f-49ea-497e-a7e8-66f0048be9e0 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:38.730050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:38.747997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6022d3d-fcdb-45c9-b221-eefdf36174f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:38.748994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6022d3d-fcdb-45c9-b221-eefdf36174f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:38.749441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6022d3d-fcdb-45c9-b221-eefdf36174f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:38.749875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6022d3d-fcdb-45c9-b221-eefdf36174f2 admin admin] PATH_INFO: `/v3/projects/0b31c2921b534167bf8c5d530fee737e/users/f65d1eb71f724c909ecc9c4e590e59a4/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:38.777013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6022d3d-fcdb-45c9-b221-eefdf36174f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b31c2921b534167bf8c5d530fee737e, user_id=f65d1eb71f724c909ecc9c4e590e59a4, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:38.780623 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6022d3d-fcdb-45c9-b221-eefdf36174f2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:38.891453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 934/1888] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:38 2022] PUT /identity/v3/projects/0b31c2921b534167bf8c5d530fee737e/users/f65d1eb71f724c909ecc9c4e590e59a4/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:38.893069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c74ca-698a-4adf-992b-77fefaa3652e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:38.908032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c74ca-698a-4adf-992b-77fefaa3652e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:38.979922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe9358-ac0d-4327-bfc8-b7d85da89b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:38.980558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9358-ac0d-4327-bfc8-b7d85da89b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:38.980863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9358-ac0d-4327-bfc8-b7d85da89b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:38.981234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9358-ac0d-4327-bfc8-b7d85da89b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:38.981910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe9358-ac0d-4327-bfc8-b7d85da89b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:38.983531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe9358-ac0d-4327-bfc8-b7d85da89b12 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:38.998106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 955/1889] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:39.002533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6022d3d-fcdb-45c9-b221-eefdf36174f2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:39.016306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6022d3d-fcdb-45c9-b221-eefdf36174f2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:39.031025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13317-d7c2-4077-9ae8-13fa2b75cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:39.032036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13317-d7c2-4077-9ae8-13fa2b75cb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:39.032522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13317-d7c2-4077-9ae8-13fa2b75cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:39.033026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13317-d7c2-4077-9ae8-13fa2b75cb28 admin admin] PATH_INFO: `/v3/projects/0b31c2921b534167bf8c5d530fee737e/users/f65d1eb71f724c909ecc9c4e590e59a4/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:39.035902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13317-d7c2-4077-9ae8-13fa2b75cb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b31c2921b534167bf8c5d530fee737e, user_id=f65d1eb71f724c909ecc9c4e590e59a4, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:39.039998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13317-d7c2-4077-9ae8-13fa2b75cb28 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:39.052527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 935/1890] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:39 2022] PUT /identity/v3/projects/0b31c2921b534167bf8c5d530fee737e/users/f65d1eb71f724c909ecc9c4e590e59a4/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:39.063481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94df2-091d-4abc-9a5b-e2aced03594b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:39.068790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94df2-091d-4abc-9a5b-e2aced03594b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:39.068790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94df2-091d-4abc-9a5b-e2aced03594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:39.093535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:39.101418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-07d94df2-091d-4abc-9a5b-e2aced03594b None None] MFA Rules not processed for user `f65d1eb71f724c909ecc9c4e590e59a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:39.102892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-07d94df2-091d-4abc-9a5b-e2aced03594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:39.202115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 956/1891] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:39.213778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13317-d7c2-4077-9ae8-13fa2b75cb28 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:39.215537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0ee13317-d7c2-4077-9ae8-13fa2b75cb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:39.293066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13317-d7c2-4077-9ae8-13fa2b75cb28 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:39.293066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a936cd-4406-4085-8517-00bc850af917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:39.293066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a936cd-4406-4085-8517-00bc850af917 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:39.293066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a936cd-4406-4085-8517-00bc850af917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:39.293362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a936cd-4406-4085-8517-00bc850af917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:39.307757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a936cd-4406-4085-8517-00bc850af917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:39.309526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a936cd-4406-4085-8517-00bc850af917 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:39.319722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 936/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:39.636116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d94df2-091d-4abc-9a5b-e2aced03594b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:39.646651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d94df2-091d-4abc-9a5b-e2aced03594b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:39.650339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d00848-71a1-4967-8711-34a796188b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:39.650854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d00848-71a1-4967-8711-34a796188b81 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:39.651132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d00848-71a1-4967-8711-34a796188b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:39.651406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d00848-71a1-4967-8711-34a796188b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:39.715131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d00848-71a1-4967-8711-34a796188b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:39.716911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d00848-71a1-4967-8711-34a796188b81 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:39.728300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 957/1893] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:40.972371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:41.377404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:42.051701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:42.995091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:43.771914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:44.057049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a936cd-4406-4085-8517-00bc850af917 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:44.058703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-30a936cd-4406-4085-8517-00bc850af917 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:44.150332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a936cd-4406-4085-8517-00bc850af917 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:44.157886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:44.159013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:44.159370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:44.159744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] PATH_INFO: `/v3/users/7d5a991da7d04a5da1e0f6a1c1b2fbe7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:44.160975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5a991da7d04a5da1e0f6a1c1b2fbe7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:44.163677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:44.254182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d00848-71a1-4967-8711-34a796188b81 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:44.267535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d00848-71a1-4967-8711-34a796188b81 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:44.273262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:44.273970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:44.274327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:44.274676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] PATH_INFO: `/v3/users/4c6ef9411fb643df8ed0414a1f92e0b0` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:44.275907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6ef9411fb643df8ed0414a1f92e0b0)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:44.277891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:44.375438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5a991da7d04a5da1e0f6a1c1b2fbe7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.457605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5a991da7d04a5da1e0f6a1c1b2fbe7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.470660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5a991da7d04a5da1e0f6a1c1b2fbe7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.471347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5a991da7d04a5da1e0f6a1c1b2fbe7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.486260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-33f1448a-96da-493c-9c25-57b1d6318457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5a991da7d04a5da1e0f6a1c1b2fbe7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.486260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 937/1894] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:44 2022] DELETE /identity/v3/users/7d5a991da7d04a5da1e0f6a1c1b2fbe7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:44.492881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57492ef9-7fa7-4911-884b-43c9a511bed4 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:44.493433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57492ef9-7fa7-4911-884b-43c9a511bed4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:44.494421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57492ef9-7fa7-4911-884b-43c9a511bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:44.507451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:44.520396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6ef9411fb643df8ed0414a1f92e0b0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.521978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6ef9411fb643df8ed0414a1f92e0b0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.523881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-57492ef9-7fa7-4911-884b-43c9a511bed4 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:44.525295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-57492ef9-7fa7-4911-884b-43c9a511bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:44.594994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 938/1895] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:44.605312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57492ef9-7fa7-4911-884b-43c9a511bed4 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:44.606700 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-57492ef9-7fa7-4911-884b-43c9a511bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:44.617303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6ef9411fb643df8ed0414a1f92e0b0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.618158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6ef9411fb643df8ed0414a1f92e0b0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.626145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-878e4b7d-f530-4cc2-8fa0-8f9e9bf8171a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6ef9411fb643df8ed0414a1f92e0b0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:44.646023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 958/1896] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:44 2022] DELETE /identity/v3/users/4c6ef9411fb643df8ed0414a1f92e0b0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:44.652122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facf281-1065-47c8-a0c0-992d8d60b79d None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:44.652472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facf281-1065-47c8-a0c0-992d8d60b79d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:44.656087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facf281-1065-47c8-a0c0-992d8d60b79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:44.681429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9facf281-1065-47c8-a0c0-992d8d60b79d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:44.682453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57492ef9-7fa7-4911-884b-43c9a511bed4 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:44.682673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9facf281-1065-47c8-a0c0-992d8d60b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:44.710413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:44.753656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:44.754538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:44.756482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:44.756917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:44.760050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:44.795083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 959/1897] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:44.795083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facf281-1065-47c8-a0c0-992d8d60b79d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:44.801151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9facf281-1065-47c8-a0c0-992d8d60b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:44.822756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facf281-1065-47c8-a0c0-992d8d60b79d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:44.827020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c42db-0a6d-41f1-b282-ccd6a058fe90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:44.829131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c42db-0a6d-41f1-b282-ccd6a058fe90 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:44.829492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c42db-0a6d-41f1-b282-ccd6a058fe90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:44.829843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c42db-0a6d-41f1-b282-ccd6a058fe90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:44.844523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:44.846799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:44.852324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c42db-0a6d-41f1-b282-ccd6a058fe90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:44.853782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c42db-0a6d-41f1-b282-ccd6a058fe90 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:44.866998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 939/1898] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:44.867788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 960/1899] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:46.510983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:46.513187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:46.530838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c29ec-db21-4212-9e23-a45a69da6720 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:46.537620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:46.538459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:46.538797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:46.539014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] PATH_INFO: `/v3/projects/9676b7b0870e4565899ab1f6384d6ec4` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:46.540219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9676b7b0870e4565899ab1f6384d6ec4)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:46.542674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:46.682637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9676b7b0870e4565899ab1f6384d6ec4', 'request_id': 'req-b5050df3-9928-4614-831e-7075fe3b7291'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:46.708114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9676b7b0870e4565899ab1f6384d6ec4', 'request_id': 'req-b5050df3-9928-4614-831e-7075fe3b7291'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:46.742277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c42db-0a6d-41f1-b282-ccd6a058fe90 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:46.743828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e06c42db-0a6d-41f1-b282-ccd6a058fe90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:46.762510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c42db-0a6d-41f1-b282-ccd6a058fe90 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:46.807093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9676b7b0870e4565899ab1f6384d6ec4', 'request_id': 'req-b5050df3-9928-4614-831e-7075fe3b7291'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:46.828563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] The token cache is being invalidate because project 9676b7b0870e4565899ab1f6384d6ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:46.829181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:46.830685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:46.833162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 940/1900] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:46 2022] DELETE /identity/v3/projects/9676b7b0870e4565899ab1f6384d6ec4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:46.838522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:46.841293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:46.843379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:46.844352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:46.844803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:46.845226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] PATH_INFO: `/v3/projects/eb0d2b23630f4a6ebee63c20ffab828c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:46.846782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0d2b23630f4a6ebee63c20ffab828c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:46.848944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:46.902221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5050df3-9928-4614-831e-7075fe3b7291 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:46.912629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:46.912935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:46.913311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:46.913821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] PATH_INFO: `/v3/users/c383992dde6b4cc5b6dd31314e3e2af1` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:46.915531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c383992dde6b4cc5b6dd31314e3e2af1)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:46.936910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:47.065581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0d2b23630f4a6ebee63c20ffab828c', 'request_id': 'req-ca7c027f-ea35-4ea6-824e-1509c69abea0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.148070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c383992dde6b4cc5b6dd31314e3e2af1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.177444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0d2b23630f4a6ebee63c20ffab828c', 'request_id': 'req-ca7c027f-ea35-4ea6-824e-1509c69abea0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.184339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0d2b23630f4a6ebee63c20ffab828c', 'request_id': 'req-ca7c027f-ea35-4ea6-824e-1509c69abea0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.195578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] The token cache is being invalidate because project eb0d2b23630f4a6ebee63c20ffab828c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:47.195915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.196592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.198395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 961/1901] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:46 2022] DELETE /identity/v3/projects/eb0d2b23630f4a6ebee63c20ffab828c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:47.203155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:47.204769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:47.246691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c383992dde6b4cc5b6dd31314e3e2af1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.263656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c383992dde6b4cc5b6dd31314e3e2af1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.265738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c383992dde6b4cc5b6dd31314e3e2af1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.276347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c383992dde6b4cc5b6dd31314e3e2af1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.317918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c027f-ea35-4ea6-824e-1509c69abea0 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:47.319609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 941/1902] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:46 2022] DELETE /identity/v3/users/c383992dde6b4cc5b6dd31314e3e2af1 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:47.437027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:47.438137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:47.438479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:47.438762 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] PATH_INFO: `/v3/users/e810d010dc7244078a0f628d3018da2f` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:47.440045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e810d010dc7244078a0f628d3018da2f)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:47.447772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:47.514871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:47.695121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e810d010dc7244078a0f628d3018da2f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.699664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e810d010dc7244078a0f628d3018da2f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.803297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e810d010dc7244078a0f628d3018da2f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.804857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e810d010dc7244078a0f628d3018da2f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.841792 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e810d010dc7244078a0f628d3018da2f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:47.880430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:47.913738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 962/1903] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:47 2022] DELETE /identity/v3/users/e810d010dc7244078a0f628d3018da2f => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:48.586170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:48.587938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:48.611523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abf456-be09-4252-8664-358f83cf6fe6 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:48.711952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:48.713084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:48.713367 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:48.714239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] PATH_INFO: `/v3/projects/e6a72e919e524ee9afb2df1eb1bafee3` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:48.716925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a72e919e524ee9afb2df1eb1bafee3)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:48.718177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:48.866075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a72e919e524ee9afb2df1eb1bafee3', 'request_id': 'req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:48.873727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a72e919e524ee9afb2df1eb1bafee3', 'request_id': 'req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:48.954895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:48.956872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:48.967053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a72e919e524ee9afb2df1eb1bafee3', 'request_id': 'req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:48.979877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced96bd-0008-4853-b86b-68f51e8cf58f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:49.018193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] The token cache is being invalidate because project e6a72e919e524ee9afb2df1eb1bafee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:49.021256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.025181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ceb9ff19-7e90-4a59-b180-38ddcb2f956b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.028176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 942/1904] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:48 2022] DELETE /identity/v3/projects/e6a72e919e524ee9afb2df1eb1bafee3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:49.033103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a333e-3d7e-4ed4-9db1-e7d2aea9d480 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:49.033673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a333e-3d7e-4ed4-9db1-e7d2aea9d480 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:49.034670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a333e-3d7e-4ed4-9db1-e7d2aea9d480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:49.105003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d89a333e-3d7e-4ed4-9db1-e7d2aea9d480 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:49.106497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d89a333e-3d7e-4ed4-9db1-e7d2aea9d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:49.145347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:49.148274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:49.148810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:49.149242 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] PATH_INFO: `/v3/projects/39bef1bdab454a2cbcdab8d7842b867c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:49.155316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39bef1bdab454a2cbcdab8d7842b867c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:49.160082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:49.167757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:49.235887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 943/1905] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:49.246648 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8aaac-4dcb-4459-8401-b470fc7cf1ab None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:49.249820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8aaac-4dcb-4459-8401-b470fc7cf1ab None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:49.249820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8aaac-4dcb-4459-8401-b470fc7cf1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:49.274987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-2ea8aaac-4dcb-4459-8401-b470fc7cf1ab None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:49.276977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2ea8aaac-4dcb-4459-8401-b470fc7cf1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:49.288420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 944/1906] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:49.292983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8aaac-4dcb-4459-8401-b470fc7cf1ab None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:49.305213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8aaac-4dcb-4459-8401-b470fc7cf1ab None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:49.310207 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74f7a9-8d39-4fe1-a08e-aa7079d4b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:49.311080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f7a9-8d39-4fe1-a08e-aa7079d4b205 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:49.311368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f7a9-8d39-4fe1-a08e-aa7079d4b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:49.311861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f7a9-8d39-4fe1-a08e-aa7079d4b205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:49.312532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74f7a9-8d39-4fe1-a08e-aa7079d4b205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:49.312929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74f7a9-8d39-4fe1-a08e-aa7079d4b205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:49.314597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74f7a9-8d39-4fe1-a08e-aa7079d4b205 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:49.331836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 945/1907] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:49.332877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74f7a9-8d39-4fe1-a08e-aa7079d4b205 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:49.343411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74f7a9-8d39-4fe1-a08e-aa7079d4b205 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:49.369053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39bef1bdab454a2cbcdab8d7842b867c', 'request_id': 'req-2ce6e6be-56ae-4e12-b9c4-68ea07302039'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.409802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1699d-c9fa-457e-9e5a-e6a6c728eacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:49.410724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1699d-c9fa-457e-9e5a-e6a6c728eacf admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:49.411370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1699d-c9fa-457e-9e5a-e6a6c728eacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:49.415849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:49.416674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1699d-c9fa-457e-9e5a-e6a6c728eacf admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:49.418555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1699d-c9fa-457e-9e5a-e6a6c728eacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:49.421260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1699d-c9fa-457e-9e5a-e6a6c728eacf admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:49.468927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39bef1bdab454a2cbcdab8d7842b867c', 'request_id': 'req-2ce6e6be-56ae-4e12-b9c4-68ea07302039'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.477520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39bef1bdab454a2cbcdab8d7842b867c', 'request_id': 'req-2ce6e6be-56ae-4e12-b9c4-68ea07302039'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.506919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] The token cache is being invalidate because project 39bef1bdab454a2cbcdab8d7842b867c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:49.507561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.513518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.515404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 963/1908] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:48 2022] DELETE /identity/v3/projects/39bef1bdab454a2cbcdab8d7842b867c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:49.519550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:49.521901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:49.546667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6e6be-56ae-4e12-b9c4-68ea07302039 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:49.562587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:49.563443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:49.564362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:49.564650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] PATH_INFO: `/v3/users/f65d1eb71f724c909ecc9c4e590e59a4` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:49.564968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 946/1909] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:49 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:49.568460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65d1eb71f724c909ecc9c4e590e59a4)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:49.568754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1699d-c9fa-457e-9e5a-e6a6c728eacf admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:49.570434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:49.570678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6aa1699d-c9fa-457e-9e5a-e6a6c728eacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:49.737145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1699d-c9fa-457e-9e5a-e6a6c728eacf admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:49.749061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cae7e5-346f-40d7-b002-4ab8a57bff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:49.752054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cae7e5-346f-40d7-b002-4ab8a57bff4f admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:49.752054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cae7e5-346f-40d7-b002-4ab8a57bff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:49.752054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cae7e5-346f-40d7-b002-4ab8a57bff4f admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:49.752054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cae7e5-346f-40d7-b002-4ab8a57bff4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:49.754087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cae7e5-346f-40d7-b002-4ab8a57bff4f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:49.830374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65d1eb71f724c909ecc9c4e590e59a4'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.831129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65d1eb71f724c909ecc9c4e590e59a4'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.895514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 947/1910] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:49 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:49.900533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cae7e5-346f-40d7-b002-4ab8a57bff4f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:49.902678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65d1eb71f724c909ecc9c4e590e59a4'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.904475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65d1eb71f724c909ecc9c4e590e59a4'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.925446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65d1eb71f724c909ecc9c4e590e59a4'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:49.938545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cae7e5-346f-40d7-b002-4ab8a57bff4f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:49.962246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 964/1911] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:49 2022] DELETE /identity/v3/users/f65d1eb71f724c909ecc9c4e590e59a4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:49.983682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbd4fc-a9a2-46ad-b21d-cf101cd9d81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:49.985560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbd4fc-a9a2-46ad-b21d-cf101cd9d81c admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:49.985857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbd4fc-a9a2-46ad-b21d-cf101cd9d81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:49.986137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbd4fc-a9a2-46ad-b21d-cf101cd9d81c admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:49.986847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbd4fc-a9a2-46ad-b21d-cf101cd9d81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:49.990667 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbd4fc-a9a2-46ad-b21d-cf101cd9d81c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:50.031245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:50.032445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 948/1912] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:50.032929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:50.168114 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf188a5-be22-41a0-9513-cde50dc33d2d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:50.178919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55985eb-817a-4fd4-835e-e52d6c8f7d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:50.179838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55985eb-817a-4fd4-835e-e52d6c8f7d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:50.180469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55985eb-817a-4fd4-835e-e52d6c8f7d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:50.181246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55985eb-817a-4fd4-835e-e52d6c8f7d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:50.182219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55985eb-817a-4fd4-835e-e52d6c8f7d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:50.184540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55985eb-817a-4fd4-835e-e52d6c8f7d25 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:50.199928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 965/1913] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:50.201401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbd4fc-a9a2-46ad-b21d-cf101cd9d81c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:50.217577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbd4fc-a9a2-46ad-b21d-cf101cd9d81c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:50.232186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d589e4-5ab8-4b9b-9ad2-53d72c1a3c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:50.233192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d589e4-5ab8-4b9b-9ad2-53d72c1a3c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:50.233728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d589e4-5ab8-4b9b-9ad2-53d72c1a3c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:50.234184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d589e4-5ab8-4b9b-9ad2-53d72c1a3c9f admin admin] PATH_INFO: `/v3/projects/b5e57e7fb5794f6c80532fa8b6eb6a70/users/71d7c6b260de4568a0d586d460b59ccd/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:50.256649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d589e4-5ab8-4b9b-9ad2-53d72c1a3c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e57e7fb5794f6c80532fa8b6eb6a70, user_id=71d7c6b260de4568a0d586d460b59ccd, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:50.259821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d589e4-5ab8-4b9b-9ad2-53d72c1a3c9f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:50.375174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 949/1914] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:50 2022] PUT /identity/v3/projects/b5e57e7fb5794f6c80532fa8b6eb6a70/users/71d7c6b260de4568a0d586d460b59ccd/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:50.387802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a0c6-4888-40a2-99c1-aedf13309f07 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:50.389378 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a0c6-4888-40a2-99c1-aedf13309f07 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:50.389969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a0c6-4888-40a2-99c1-aedf13309f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:50.453642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3204a0c6-4888-40a2-99c1-aedf13309f07 None None] MFA Rules not processed for user `71d7c6b260de4568a0d586d460b59ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:50.457916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3204a0c6-4888-40a2-99c1-aedf13309f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:50.545132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:50.612578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 966/1915] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:50.617474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d589e4-5ab8-4b9b-9ad2-53d72c1a3c9f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:50.733711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d589e4-5ab8-4b9b-9ad2-53d72c1a3c9f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:50.739277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc5398-1df9-4e39-926b-fcf745efb5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:50.740503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5398-1df9-4e39-926b-fcf745efb5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:50.740894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5398-1df9-4e39-926b-fcf745efb5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:50.741240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5398-1df9-4e39-926b-fcf745efb5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:50.742117 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc5398-1df9-4e39-926b-fcf745efb5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:50.744263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc5398-1df9-4e39-926b-fcf745efb5c1 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:50.910470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:50.918073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 950/1916] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:50 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:50.922203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a0c6-4888-40a2-99c1-aedf13309f07 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:50.933279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a0c6-4888-40a2-99c1-aedf13309f07 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:50.991598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc5398-1df9-4e39-926b-fcf745efb5c1 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:50.995737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8acc5398-1df9-4e39-926b-fcf745efb5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:51.003059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561eb16-3280-4bc6-8731-02d7d9101811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.003859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561eb16-3280-4bc6-8731-02d7d9101811 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.004360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561eb16-3280-4bc6-8731-02d7d9101811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.004838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561eb16-3280-4bc6-8731-02d7d9101811 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.005926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561eb16-3280-4bc6-8731-02d7d9101811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.009089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561eb16-3280-4bc6-8731-02d7d9101811 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.107868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc5398-1df9-4e39-926b-fcf745efb5c1 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.124453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 967/1917] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:50 2022] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:51.128590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561eb16-3280-4bc6-8731-02d7d9101811 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.132427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.133408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.133888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.134358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] PATH_INFO: `/v3/projects/0b31c2921b534167bf8c5d530fee737e` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.135997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b31c2921b534167bf8c5d530fee737e)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.138236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.150448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561eb16-3280-4bc6-8731-02d7d9101811 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.168067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19f4c-cd0b-462e-9f6e-29eeb1e2dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.169004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19f4c-cd0b-462e-9f6e-29eeb1e2dc1c admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.172955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19f4c-cd0b-462e-9f6e-29eeb1e2dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.172955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19f4c-cd0b-462e-9f6e-29eeb1e2dc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.175138 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19f4c-cd0b-462e-9f6e-29eeb1e2dc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.178903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19f4c-cd0b-462e-9f6e-29eeb1e2dc1c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.200327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 968/1918] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:51.204825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19f4c-cd0b-462e-9f6e-29eeb1e2dc1c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.220902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19f4c-cd0b-462e-9f6e-29eeb1e2dc1c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.228391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d144350-2143-406e-80cd-62790806fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.229187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d144350-2143-406e-80cd-62790806fd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.229563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d144350-2143-406e-80cd-62790806fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.229929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d144350-2143-406e-80cd-62790806fd65 admin admin] PATH_INFO: `/v3/projects/99bc9021a1d64784a8bca97c20ad3717/users/631a5b4380cc412dbee15131102d9636/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.253287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d144350-2143-406e-80cd-62790806fd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99bc9021a1d64784a8bca97c20ad3717, user_id=631a5b4380cc412dbee15131102d9636, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.258012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d144350-2143-406e-80cd-62790806fd65 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.305380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b31c2921b534167bf8c5d530fee737e', 'request_id': 'req-fef4bf21-5527-4361-8231-399c7a778ba8'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:51.315753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b31c2921b534167bf8c5d530fee737e', 'request_id': 'req-fef4bf21-5527-4361-8231-399c7a778ba8'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:51.414066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b31c2921b534167bf8c5d530fee737e', 'request_id': 'req-fef4bf21-5527-4361-8231-399c7a778ba8'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:51.420569 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 969/1919] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:51 2022] PUT /identity/v3/projects/99bc9021a1d64784a8bca97c20ad3717/users/631a5b4380cc412dbee15131102d9636/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:51.425332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d144350-2143-406e-80cd-62790806fd65 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.427251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] The token cache is being invalidate because project 0b31c2921b534167bf8c5d530fee737e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:51.427572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:51.428256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fef4bf21-5527-4361-8231-399c7a778ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:51.429750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 951/1920] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:50 2022] DELETE /identity/v3/projects/0b31c2921b534167bf8c5d530fee737e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:51.435883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9414cc-f396-4f12-a571-23a3b52049c4 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.436177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9414cc-f396-4f12-a571-23a3b52049c4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.436461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9414cc-f396-4f12-a571-23a3b52049c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.457759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-7b9414cc-f396-4f12-a571-23a3b52049c4 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:51.459975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7b9414cc-f396-4f12-a571-23a3b52049c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:51.493869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d144350-2143-406e-80cd-62790806fd65 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.498761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9640f-4689-424a-bb93-1069fdab368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.499373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9640f-4689-424a-bb93-1069fdab368a admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.500364 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9640f-4689-424a-bb93-1069fdab368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.500364 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9640f-4689-424a-bb93-1069fdab368a admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.501164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9640f-4689-424a-bb93-1069fdab368a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.502335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9640f-4689-424a-bb93-1069fdab368a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.513829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 970/1921] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:51.517891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9640f-4689-424a-bb93-1069fdab368a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.520228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b4d9640f-4689-424a-bb93-1069fdab368a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:51.529322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 952/1922] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:51.534472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdbec9-df9c-4f69-aed7-0ef13fd7eaee None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.534861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdbec9-df9c-4f69-aed7-0ef13fd7eaee None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.534998 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9640f-4689-424a-bb93-1069fdab368a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.535117 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdbec9-df9c-4f69-aed7-0ef13fd7eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.540078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717df4-cc5f-411c-96cc-502a0f75ce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.540749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717df4-cc5f-411c-96cc-502a0f75ce92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.541086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717df4-cc5f-411c-96cc-502a0f75ce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.541463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717df4-cc5f-411c-96cc-502a0f75ce92 admin admin] PATH_INFO: `/v3/projects/99bc9021a1d64784a8bca97c20ad3717/users/631a5b4380cc412dbee15131102d9636/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.543438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05717df4-cc5f-411c-96cc-502a0f75ce92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99bc9021a1d64784a8bca97c20ad3717, user_id=631a5b4380cc412dbee15131102d9636, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.546096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05717df4-cc5f-411c-96cc-502a0f75ce92 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.555926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-7efdbec9-df9c-4f69-aed7-0ef13fd7eaee None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:51.556832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 971/1923] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:51 2022] PUT /identity/v3/projects/99bc9021a1d64784a8bca97c20ad3717/users/631a5b4380cc412dbee15131102d9636/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:51.557029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7efdbec9-df9c-4f69-aed7-0ef13fd7eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:51.569241 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0f59-6536-461c-b9b3-2076fa7aafe3 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.569614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0f59-6536-461c-b9b3-2076fa7aafe3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.569946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0f59-6536-461c-b9b3-2076fa7aafe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.599063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b83b0f59-6536-461c-b9b3-2076fa7aafe3 None None] MFA Rules not processed for user `631a5b4380cc412dbee15131102d9636`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:51.600358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b83b0f59-6536-461c-b9b3-2076fa7aafe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:51.623828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 953/1924] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:51.625779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdbec9-df9c-4f69-aed7-0ef13fd7eaee None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.636072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdbec9-df9c-4f69-aed7-0ef13fd7eaee None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.640934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad469324-3d66-4ee2-81ad-784b11aab8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.641664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad469324-3d66-4ee2-81ad-784b11aab8af admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.641952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad469324-3d66-4ee2-81ad-784b11aab8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.642228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad469324-3d66-4ee2-81ad-784b11aab8af admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.642942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad469324-3d66-4ee2-81ad-784b11aab8af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:51.645699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad469324-3d66-4ee2-81ad-784b11aab8af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.645699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad469324-3d66-4ee2-81ad-784b11aab8af admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.658253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 954/1925] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:18:51.663705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad469324-3d66-4ee2-81ad-784b11aab8af admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.673670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad469324-3d66-4ee2-81ad-784b11aab8af admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.678874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1726ab-d396-4389-9c6b-97adc09ffa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.679494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1726ab-d396-4389-9c6b-97adc09ffa59 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.679816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1726ab-d396-4389-9c6b-97adc09ffa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.680095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1726ab-d396-4389-9c6b-97adc09ffa59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.680735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1726ab-d396-4389-9c6b-97adc09ffa59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.682636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1726ab-d396-4389-9c6b-97adc09ffa59 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.698267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 972/1926] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:18:51.705198 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0f59-6536-461c-b9b3-2076fa7aafe3 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.706815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b83b0f59-6536-461c-b9b3-2076fa7aafe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:51.762688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0f59-6536-461c-b9b3-2076fa7aafe3 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.766504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a7bc5-01a7-455a-a035-312c302110b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.767226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a7bc5-01a7-455a-a035-312c302110b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.767528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a7bc5-01a7-455a-a035-312c302110b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.767827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a7bc5-01a7-455a-a035-312c302110b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.777747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a7bc5-01a7-455a-a035-312c302110b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.779334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a7bc5-01a7-455a-a035-312c302110b8 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.789124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 973/1927] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:18:51.802019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 955/1928] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:51 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:51.807276 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a7bc5-01a7-455a-a035-312c302110b8 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.817578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a7bc5-01a7-455a-a035-312c302110b8 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.873904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70c1d7-e9f5-4f6e-80ef-47bbda72fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.874512 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70c1d7-e9f5-4f6e-80ef-47bbda72fd77 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.874848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70c1d7-e9f5-4f6e-80ef-47bbda72fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.875171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70c1d7-e9f5-4f6e-80ef-47bbda72fd77 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.875843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70c1d7-e9f5-4f6e-80ef-47bbda72fd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.877756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70c1d7-e9f5-4f6e-80ef-47bbda72fd77 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.903053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:51.950089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 974/1929] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:51 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:51.954457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1726ab-d396-4389-9c6b-97adc09ffa59 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.960547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:51.965236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1726ab-d396-4389-9c6b-97adc09ffa59 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:51.971550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8f2db-0bc4-4b6a-9d1e-dd930a829737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:51.971550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f2db-0bc4-4b6a-9d1e-dd930a829737 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:51.971550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f2db-0bc4-4b6a-9d1e-dd930a829737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:51.971550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f2db-0bc4-4b6a-9d1e-dd930a829737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:51.971998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8f2db-0bc4-4b6a-9d1e-dd930a829737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:51.973512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8f2db-0bc4-4b6a-9d1e-dd930a829737 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:51.984161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 956/1930] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:51.988266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70c1d7-e9f5-4f6e-80ef-47bbda72fd77 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:51.998627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70c1d7-e9f5-4f6e-80ef-47bbda72fd77 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:52.003174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3513b7-602b-43db-afeb-10416b4f53b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:52.003820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3513b7-602b-43db-afeb-10416b4f53b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:52.004106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3513b7-602b-43db-afeb-10416b4f53b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:52.004380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3513b7-602b-43db-afeb-10416b4f53b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:52.005019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3513b7-602b-43db-afeb-10416b4f53b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:52.006600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3513b7-602b-43db-afeb-10416b4f53b7 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:52.016457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 975/1931] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:52.020826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8f2db-0bc4-4b6a-9d1e-dd930a829737 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:52.030680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8f2db-0bc4-4b6a-9d1e-dd930a829737 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:52.039908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c671148-aa84-4d6a-991a-f223e14d27dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:52.039908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c671148-aa84-4d6a-991a-f223e14d27dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:52.039908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c671148-aa84-4d6a-991a-f223e14d27dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:52.039908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c671148-aa84-4d6a-991a-f223e14d27dd admin admin] PATH_INFO: `/v3/projects/6916d8575b7c4dc980bfabdade609d68/users/58ee771d856e4ded8b217546caf40631/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:52.051908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c671148-aa84-4d6a-991a-f223e14d27dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6916d8575b7c4dc980bfabdade609d68, user_id=58ee771d856e4ded8b217546caf40631, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:52.055372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c671148-aa84-4d6a-991a-f223e14d27dd admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:52.137233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 957/1932] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:52 2022] PUT /identity/v3/projects/6916d8575b7c4dc980bfabdade609d68/users/58ee771d856e4ded8b217546caf40631/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:52.148954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09377a18-c87d-408c-bccf-8751ca112fec None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:52.149254 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09377a18-c87d-408c-bccf-8751ca112fec None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:52.149526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09377a18-c87d-408c-bccf-8751ca112fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:52.178678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-09377a18-c87d-408c-bccf-8751ca112fec None None] MFA Rules not processed for user `58ee771d856e4ded8b217546caf40631`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:52.179958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-09377a18-c87d-408c-bccf-8751ca112fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:52.255774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 976/1933] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:52.267106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c671148-aa84-4d6a-991a-f223e14d27dd admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:52.321563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c671148-aa84-4d6a-991a-f223e14d27dd admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:52.328454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89e45f-4934-452e-bc60-c53484680c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:52.328454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89e45f-4934-452e-bc60-c53484680c31 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:52.328454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89e45f-4934-452e-bc60-c53484680c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:52.328454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89e45f-4934-452e-bc60-c53484680c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:52.336094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89e45f-4934-452e-bc60-c53484680c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:52.337509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89e45f-4934-452e-bc60-c53484680c31 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:52.347456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 958/1934] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:52.372816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09377a18-c87d-408c-bccf-8751ca112fec None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:52.456086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09377a18-c87d-408c-bccf-8751ca112fec None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:52.463477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:52.465344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:52.465948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:52.466426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] PATH_INFO: `/v3/users/58ee771d856e4ded8b217546caf40631` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:52.468398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ee771d856e4ded8b217546caf40631)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:52.471942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:52.491736 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:52.730816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ee771d856e4ded8b217546caf40631'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:52.731507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ee771d856e4ded8b217546caf40631'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:52.847559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ee771d856e4ded8b217546caf40631'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:52.848307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ee771d856e4ded8b217546caf40631'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:52.856106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ee771d856e4ded8b217546caf40631'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:52.873820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 977/1935] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:52 2022] DELETE /identity/v3/users/58ee771d856e4ded8b217546caf40631 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:52.878400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc9909-a26f-4b6f-9f49-a398d5ba917f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:52.878995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc9909-a26f-4b6f-9f49-a398d5ba917f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:52.878995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc9909-a26f-4b6f-9f49-a398d5ba917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:52.904788 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8edc9909-a26f-4b6f-9f49-a398d5ba917f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:52.905104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8edc9909-a26f-4b6f-9f49-a398d5ba917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:52.976104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 959/1936] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:52.986187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:52.987740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:53.046849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0149de-5702-48bf-965e-6cd570a8ab77 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:53.050622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa5bc-93d4-4c17-9422-cfb202388049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:53.051245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa5bc-93d4-4c17-9422-cfb202388049 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:53.051527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa5bc-93d4-4c17-9422-cfb202388049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:53.051833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa5bc-93d4-4c17-9422-cfb202388049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:53.061936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa5bc-93d4-4c17-9422-cfb202388049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:53.066014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa5bc-93d4-4c17-9422-cfb202388049 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:53.076854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 978/1937] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:53.082226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc9909-a26f-4b6f-9f49-a398d5ba917f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:53.084813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8edc9909-a26f-4b6f-9f49-a398d5ba917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:53.087072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:53.097725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc9909-a26f-4b6f-9f49-a398d5ba917f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:53.102547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:53.103212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:53.103673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:53.104029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] PATH_INFO: `/v3/users/71d7c6b260de4568a0d586d460b59ccd` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:53.105197 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d7c6b260de4568a0d586d460b59ccd)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:53.107196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:53.375932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d7c6b260de4568a0d586d460b59ccd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.445994 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d7c6b260de4568a0d586d460b59ccd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.458979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d7c6b260de4568a0d586d460b59ccd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.459859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d7c6b260de4568a0d586d460b59ccd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.472558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d7c6b260de4568a0d586d460b59ccd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.472997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 960/1938] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:53 2022] DELETE /identity/v3/users/71d7c6b260de4568a0d586d460b59ccd => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:53.478939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d1f15-1315-4f2e-b249-f545964718df None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:53.479231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d1f15-1315-4f2e-b249-f545964718df None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:53.479508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d1f15-1315-4f2e-b249-f545964718df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:53.486691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:53.488374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:53.502594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d86d1f15-1315-4f2e-b249-f545964718df None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:53.504147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d86d1f15-1315-4f2e-b249-f545964718df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:53.504703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:53.577804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02939362-6b5b-473e-a6d1-b30ae9af0814 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:53.583195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:53.583445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:53.583783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:53.584061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] PATH_INFO: `/v3/projects/6916d8575b7c4dc980bfabdade609d68` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:53.585177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6916d8575b7c4dc980bfabdade609d68)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:53.587088 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:53.589557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 979/1939] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:53.600072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d1f15-1315-4f2e-b249-f545964718df None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:53.601452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d86d1f15-1315-4f2e-b249-f545964718df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:53.656701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d1f15-1315-4f2e-b249-f545964718df None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:53.660195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485342f-3d3b-4a74-a302-f48029b2c157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:53.660810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485342f-3d3b-4a74-a302-f48029b2c157 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:53.661091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485342f-3d3b-4a74-a302-f48029b2c157 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:53.661421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485342f-3d3b-4a74-a302-f48029b2c157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:53.672496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485342f-3d3b-4a74-a302-f48029b2c157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:53.677820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485342f-3d3b-4a74-a302-f48029b2c157 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:53.695904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 980/1940] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:18:53.698672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6916d8575b7c4dc980bfabdade609d68', 'request_id': 'req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.707281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6916d8575b7c4dc980bfabdade609d68', 'request_id': 'req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.822640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6916d8575b7c4dc980bfabdade609d68', 'request_id': 'req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.847320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] The token cache is being invalidate because project 6916d8575b7c4dc980bfabdade609d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:53.847731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.848506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7dfa3e18-b6ba-4a5a-9ef7-8ee49ebfeb41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:53.854338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 961/1941] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:53 2022] DELETE /identity/v3/projects/6916d8575b7c4dc980bfabdade609d68 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:18:53.859519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32a230-7bda-4679-9424-6ca9548b5f4b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:53.859845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32a230-7bda-4679-9424-6ca9548b5f4b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:53.860126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32a230-7bda-4679-9424-6ca9548b5f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:53.887320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6d32a230-7bda-4679-9424-6ca9548b5f4b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:53.888610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6d32a230-7bda-4679-9424-6ca9548b5f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:53.955725 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 981/1942] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:53.965586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9970f-10f3-4716-9e6c-132c8a4b33f8 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:53.966135 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9970f-10f3-4716-9e6c-132c8a4b33f8 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:53.966135 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9970f-10f3-4716-9e6c-132c8a4b33f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:53.997802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6cb9970f-10f3-4716-9e6c-132c8a4b33f8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:53.999165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6cb9970f-10f3-4716-9e6c-132c8a4b33f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:54.007242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 962/1943] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:54.012437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32a230-7bda-4679-9424-6ca9548b5f4b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:54.023339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32a230-7bda-4679-9424-6ca9548b5f4b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:54.028277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e6053-ab3f-429c-aa3c-cc58fc352ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:54.028966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e6053-ab3f-429c-aa3c-cc58fc352ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:54.029299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e6053-ab3f-429c-aa3c-cc58fc352ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:54.029619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e6053-ab3f-429c-aa3c-cc58fc352ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:54.030307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e6053-ab3f-429c-aa3c-cc58fc352ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:54.030607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e6053-ab3f-429c-aa3c-cc58fc352ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:54.032300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e6053-ab3f-429c-aa3c-cc58fc352ee5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:54.045996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 982/1944] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:54.050499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9970f-10f3-4716-9e6c-132c8a4b33f8 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:54.060360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9970f-10f3-4716-9e6c-132c8a4b33f8 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:54.066198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755044a-c269-4071-ad6c-94a3b22b7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:54.066816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755044a-c269-4071-ad6c-94a3b22b7248 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:54.067103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755044a-c269-4071-ad6c-94a3b22b7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:54.074018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755044a-c269-4071-ad6c-94a3b22b7248 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:54.074018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755044a-c269-4071-ad6c-94a3b22b7248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:54.074018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755044a-c269-4071-ad6c-94a3b22b7248 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:54.123386 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:54.184163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 963/1945] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:54 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:54.188575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e6053-ab3f-429c-aa3c-cc58fc352ee5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:54.199412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e6053-ab3f-429c-aa3c-cc58fc352ee5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:54.269313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:54.282329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33e2b5-cfd5-439e-b2df-037065c0f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:54.282908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33e2b5-cfd5-439e-b2df-037065c0f5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:54.283189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33e2b5-cfd5-439e-b2df-037065c0f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:54.283492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33e2b5-cfd5-439e-b2df-037065c0f5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:54.284315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33e2b5-cfd5-439e-b2df-037065c0f5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:54.286163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33e2b5-cfd5-439e-b2df-037065c0f5b8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:54.373983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 983/1946] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:54 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:54.378009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755044a-c269-4071-ad6c-94a3b22b7248 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:54.389270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755044a-c269-4071-ad6c-94a3b22b7248 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:54.394214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899344e-0cd3-4f13-bf2a-8ad7ea35cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:54.394826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899344e-0cd3-4f13-bf2a-8ad7ea35cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:54.395208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899344e-0cd3-4f13-bf2a-8ad7ea35cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:54.395646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899344e-0cd3-4f13-bf2a-8ad7ea35cd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:54.397056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899344e-0cd3-4f13-bf2a-8ad7ea35cd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:54.398827 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899344e-0cd3-4f13-bf2a-8ad7ea35cd41 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:54.409262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 964/1947] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:18:54.413270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33e2b5-cfd5-439e-b2df-037065c0f5b8 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:54.427159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33e2b5-cfd5-439e-b2df-037065c0f5b8 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:54.432460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913464c-89fb-4001-acd6-7ac458922250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:54.433187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913464c-89fb-4001-acd6-7ac458922250 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:54.435935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913464c-89fb-4001-acd6-7ac458922250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:54.435935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913464c-89fb-4001-acd6-7ac458922250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:54.435935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913464c-89fb-4001-acd6-7ac458922250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:54.436545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913464c-89fb-4001-acd6-7ac458922250 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:54.467174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 984/1948] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:54.470247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899344e-0cd3-4f13-bf2a-8ad7ea35cd41 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:54.490094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899344e-0cd3-4f13-bf2a-8ad7ea35cd41 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:54.498534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddf4d2-973d-4465-9579-dc987efa7fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:54.499231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddf4d2-973d-4465-9579-dc987efa7fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:54.499515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddf4d2-973d-4465-9579-dc987efa7fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:54.499848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddf4d2-973d-4465-9579-dc987efa7fc2 admin admin] PATH_INFO: `/v3/projects/196cf7bb302d4a6cb3a235386b3446a8/users/81e5b2e9ebc942cba33269302c60248d/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:54.522578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddf4d2-973d-4465-9579-dc987efa7fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196cf7bb302d4a6cb3a235386b3446a8, user_id=81e5b2e9ebc942cba33269302c60248d, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:54.526619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddf4d2-973d-4465-9579-dc987efa7fc2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:54.614185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 965/1949] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:54 2022] PUT /identity/v3/projects/196cf7bb302d4a6cb3a235386b3446a8/users/81e5b2e9ebc942cba33269302c60248d/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:54.627373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f573-bc77-4ed8-95d3-105d38ba3bb5 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:54.627699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f573-bc77-4ed8-95d3-105d38ba3bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:54.627980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f573-bc77-4ed8-95d3-105d38ba3bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:54.666976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d984f573-bc77-4ed8-95d3-105d38ba3bb5 None None] MFA Rules not processed for user `81e5b2e9ebc942cba33269302c60248d`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:54.668267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d984f573-bc77-4ed8-95d3-105d38ba3bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:54.675251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:54.738656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 985/1950] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:54.750581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddf4d2-973d-4465-9579-dc987efa7fc2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:54.752272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7bddf4d2-973d-4465-9579-dc987efa7fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:54.807889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddf4d2-973d-4465-9579-dc987efa7fc2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:54.811757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c0780-f891-4b79-9184-f8ae0f8f668d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:54.812382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c0780-f891-4b79-9184-f8ae0f8f668d service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:54.812692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c0780-f891-4b79-9184-f8ae0f8f668d service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:54.812969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c0780-f891-4b79-9184-f8ae0f8f668d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:54.822761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c0780-f891-4b79-9184-f8ae0f8f668d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:54.824296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c0780-f891-4b79-9184-f8ae0f8f668d service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:54.842155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984f573-bc77-4ed8-95d3-105d38ba3bb5 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:54.847248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d984f573-bc77-4ed8-95d3-105d38ba3bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:54.854510 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 966/1951] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:55.014917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984f573-bc77-4ed8-95d3-105d38ba3bb5 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:55.029591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:55.030253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:55.034645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:55.034955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] PATH_INFO: `/v3/projects/b5e57e7fb5794f6c80532fa8b6eb6a70` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:55.036962 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e57e7fb5794f6c80532fa8b6eb6a70)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:55.038881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:55.145775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e57e7fb5794f6c80532fa8b6eb6a70', 'request_id': 'req-6cb3ef9e-8972-49cd-aab1-9776c65a1510'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.211964 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e57e7fb5794f6c80532fa8b6eb6a70', 'request_id': 'req-6cb3ef9e-8972-49cd-aab1-9776c65a1510'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.218958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e57e7fb5794f6c80532fa8b6eb6a70', 'request_id': 'req-6cb3ef9e-8972-49cd-aab1-9776c65a1510'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.238464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] The token cache is being invalidate because project b5e57e7fb5794f6c80532fa8b6eb6a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:55.238757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.239484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.241257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 986/1952] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:54 2022] DELETE /identity/v3/projects/b5e57e7fb5794f6c80532fa8b6eb6a70 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:55.246121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c0780-f891-4b79-9184-f8ae0f8f668d service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:55.260195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c0780-f891-4b79-9184-f8ae0f8f668d service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:55.367918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:55.368763 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:55.369052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:55.369340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] PATH_INFO: `/v3/users/631a5b4380cc412dbee15131102d9636` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:55.372944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631a5b4380cc412dbee15131102d9636)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:55.375016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:55.400575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:55.480950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:55.599172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631a5b4380cc412dbee15131102d9636'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.697237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631a5b4380cc412dbee15131102d9636'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.720714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631a5b4380cc412dbee15131102d9636'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.722088 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631a5b4380cc412dbee15131102d9636'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.732530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d12bbe47-b7a1-4503-80db-d8a722730330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631a5b4380cc412dbee15131102d9636'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:55.738905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 967/1953] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:18:55 2022] DELETE /identity/v3/users/631a5b4380cc412dbee15131102d9636 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:56.230181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:56.231877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:56.254649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3ef9e-8972-49cd-aab1-9776c65a1510 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:56.314382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:56.315023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:56.315371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:56.315672 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] PATH_INFO: `/v3/projects/99bc9021a1d64784a8bca97c20ad3717` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:56.316862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99bc9021a1d64784a8bca97c20ad3717)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:56.319021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:56.450832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99bc9021a1d64784a8bca97c20ad3717', 'request_id': 'req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:56.575118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99bc9021a1d64784a8bca97c20ad3717', 'request_id': 'req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:56.586755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99bc9021a1d64784a8bca97c20ad3717', 'request_id': 'req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:56.601307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] The token cache is being invalidate because project 99bc9021a1d64784a8bca97c20ad3717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:18:56.601740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:56.602661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-04ff2bba-7a36-48c2-9f7e-bc0a0e361032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:18:56.606217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 987/1954] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:18:56 2022] DELETE /identity/v3/projects/99bc9021a1d64784a8bca97c20ad3717 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:56.609744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30309af2-b811-4ef7-b2b1-26fca874c23e None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:56.610296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30309af2-b811-4ef7-b2b1-26fca874c23e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:56.611800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30309af2-b811-4ef7-b2b1-26fca874c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:56.634574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-30309af2-b811-4ef7-b2b1-26fca874c23e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:56.635830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-30309af2-b811-4ef7-b2b1-26fca874c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:56.720730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 968/1955] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:56.728907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791fb2d-297e-4725-adb3-c0fc106db714 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:56.729393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791fb2d-297e-4725-adb3-c0fc106db714 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:56.729734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791fb2d-297e-4725-adb3-c0fc106db714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:56.750067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9791fb2d-297e-4725-adb3-c0fc106db714 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:56.751287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9791fb2d-297e-4725-adb3-c0fc106db714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:56.759965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 988/1956] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:56.764713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30309af2-b811-4ef7-b2b1-26fca874c23e None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:56.776285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30309af2-b811-4ef7-b2b1-26fca874c23e None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:56.781705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506579a-dc6d-483d-9739-5d95ff3506f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:56.782324 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506579a-dc6d-483d-9739-5d95ff3506f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:56.785793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506579a-dc6d-483d-9739-5d95ff3506f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:56.785793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506579a-dc6d-483d-9739-5d95ff3506f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:56.785793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506579a-dc6d-483d-9739-5d95ff3506f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:18:56.785793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506579a-dc6d-483d-9739-5d95ff3506f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:56.785793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506579a-dc6d-483d-9739-5d95ff3506f6 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:56.797883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 969/1957] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:18:56.802387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791fb2d-297e-4725-adb3-c0fc106db714 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:56.811965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791fb2d-297e-4725-adb3-c0fc106db714 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:56.816745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8cc5a-be7a-4d86-a1b6-746feb0c33cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:56.817353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8cc5a-be7a-4d86-a1b6-746feb0c33cd admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:56.818141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8cc5a-be7a-4d86-a1b6-746feb0c33cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:56.818472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8cc5a-be7a-4d86-a1b6-746feb0c33cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:56.819123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8cc5a-be7a-4d86-a1b6-746feb0c33cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:56.821041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8cc5a-be7a-4d86-a1b6-746feb0c33cd admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:56.949368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:56.959567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 989/1958] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:56 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:56.961006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506579a-dc6d-483d-9739-5d95ff3506f6 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:56.972714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506579a-dc6d-483d-9739-5d95ff3506f6 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:57.034608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec5ce5-b762-4a4f-b396-839534e3092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:57.035791 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec5ce5-b762-4a4f-b396-839534e3092e admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:57.036075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec5ce5-b762-4a4f-b396-839534e3092e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:57.036350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec5ce5-b762-4a4f-b396-839534e3092e admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:57.036983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec5ce5-b762-4a4f-b396-839534e3092e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:57.038894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec5ce5-b762-4a4f-b396-839534e3092e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:57.103411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 970/1959] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:56 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:18:57.107818 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8cc5a-be7a-4d86-a1b6-746feb0c33cd admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:57.119072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8cc5a-be7a-4d86-a1b6-746feb0c33cd admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:57.123747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482cc63-c093-44e2-b79c-566ccffb7224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:57.124291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482cc63-c093-44e2-b79c-566ccffb7224 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:57.124575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482cc63-c093-44e2-b79c-566ccffb7224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:57.124854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482cc63-c093-44e2-b79c-566ccffb7224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:57.125500 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482cc63-c093-44e2-b79c-566ccffb7224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:57.127085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482cc63-c093-44e2-b79c-566ccffb7224 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:57.135239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:57.140624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 990/1960] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:57.144805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec5ce5-b762-4a4f-b396-839534e3092e admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:57.155187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec5ce5-b762-4a4f-b396-839534e3092e admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:57.159973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039acb9-ef91-4ee6-a948-40bbe12d6796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:57.160595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039acb9-ef91-4ee6-a948-40bbe12d6796 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:57.160880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039acb9-ef91-4ee6-a948-40bbe12d6796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:57.161158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039acb9-ef91-4ee6-a948-40bbe12d6796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:57.161805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039acb9-ef91-4ee6-a948-40bbe12d6796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:57.163467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039acb9-ef91-4ee6-a948-40bbe12d6796 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:57.178786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 971/1961] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:57.180186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482cc63-c093-44e2-b79c-566ccffb7224 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:57.190356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482cc63-c093-44e2-b79c-566ccffb7224 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:57.196767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab588a55-e912-40a6-bd52-40e78cb96b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:57.196767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab588a55-e912-40a6-bd52-40e78cb96b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:57.196968 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab588a55-e912-40a6-bd52-40e78cb96b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:57.197082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab588a55-e912-40a6-bd52-40e78cb96b1a admin admin] PATH_INFO: `/v3/projects/0ea696cda4704b39bf3c63781f2e207c/users/c840d8e55c4e408ba892d6fb1410b563/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:57.212464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab588a55-e912-40a6-bd52-40e78cb96b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea696cda4704b39bf3c63781f2e207c, user_id=c840d8e55c4e408ba892d6fb1410b563, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:57.215144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab588a55-e912-40a6-bd52-40e78cb96b1a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:57.320301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 991/1962] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:57 2022] PUT /identity/v3/projects/0ea696cda4704b39bf3c63781f2e207c/users/c840d8e55c4e408ba892d6fb1410b563/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:57.331995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcfb70-2714-464d-96cf-bb8c8c85a235 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:57.332277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcfb70-2714-464d-96cf-bb8c8c85a235 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:57.332564 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcfb70-2714-464d-96cf-bb8c8c85a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:57.359991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-19dcfb70-2714-464d-96cf-bb8c8c85a235 None None] MFA Rules not processed for user `c840d8e55c4e408ba892d6fb1410b563`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:57.361192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-19dcfb70-2714-464d-96cf-bb8c8c85a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:57.424432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 972/1963] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:57.433666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab588a55-e912-40a6-bd52-40e78cb96b1a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:57.498263 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab588a55-e912-40a6-bd52-40e78cb96b1a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:57.503901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5ed4b-eb71-4c50-b3d5-5cb1374f2afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:57.504608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ed4b-eb71-4c50-b3d5-5cb1374f2afa admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:57.504999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ed4b-eb71-4c50-b3d5-5cb1374f2afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:57.505403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ed4b-eb71-4c50-b3d5-5cb1374f2afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:57.506133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5ed4b-eb71-4c50-b3d5-5cb1374f2afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:57.508140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5ed4b-eb71-4c50-b3d5-5cb1374f2afa admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:57.646348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 992/1964] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:18:57 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:57.646971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcfb70-2714-464d-96cf-bb8c8c85a235 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:57.657999 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcfb70-2714-464d-96cf-bb8c8c85a235 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:57.743791 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92aae9-7131-4246-af32-c68b5e5e6c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:57.744425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92aae9-7131-4246-af32-c68b5e5e6c88 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:57.744985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92aae9-7131-4246-af32-c68b5e5e6c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:57.745327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92aae9-7131-4246-af32-c68b5e5e6c88 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:57.746025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92aae9-7131-4246-af32-c68b5e5e6c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:57.748403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92aae9-7131-4246-af32-c68b5e5e6c88 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:57.754797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:57.874423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 973/1965] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:18:57 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:18:57.878657 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5ed4b-eb71-4c50-b3d5-5cb1374f2afa admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:57.888977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5ed4b-eb71-4c50-b3d5-5cb1374f2afa admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:57.892121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:57.897913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725329c-9c21-4229-8545-46bbed83db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:57.898538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725329c-9c21-4229-8545-46bbed83db0e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:57.899037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725329c-9c21-4229-8545-46bbed83db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:57.899312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725329c-9c21-4229-8545-46bbed83db0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:57.900011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725329c-9c21-4229-8545-46bbed83db0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:57.901967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725329c-9c21-4229-8545-46bbed83db0e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:57.914010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 993/1966] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:57.918518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92aae9-7131-4246-af32-c68b5e5e6c88 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:57.928539 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92aae9-7131-4246-af32-c68b5e5e6c88 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:57.933131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215cdd-cad7-4089-8b2f-5f8d3b74d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:57.933790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215cdd-cad7-4089-8b2f-5f8d3b74d036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:57.934073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215cdd-cad7-4089-8b2f-5f8d3b74d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:57.934352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215cdd-cad7-4089-8b2f-5f8d3b74d036 admin admin] PATH_INFO: `/v3/projects/847bac9200ae461c935037c5d48df8ff/users/857d96cd423342efb595164b8497d966/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:57.949826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215cdd-cad7-4089-8b2f-5f8d3b74d036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847bac9200ae461c935037c5d48df8ff, user_id=857d96cd423342efb595164b8497d966, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:57.952505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215cdd-cad7-4089-8b2f-5f8d3b74d036 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:58.031192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 974/1967] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:57 2022] PUT /identity/v3/projects/847bac9200ae461c935037c5d48df8ff/users/857d96cd423342efb595164b8497d966/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:58.037175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725329c-9c21-4229-8545-46bbed83db0e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:58.047350 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725329c-9c21-4229-8545-46bbed83db0e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:58.105946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14195e-6105-4627-abaf-ec133484ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:58.106573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14195e-6105-4627-abaf-ec133484ca25 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:58.106939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14195e-6105-4627-abaf-ec133484ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:58.107414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14195e-6105-4627-abaf-ec133484ca25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:58.108163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14195e-6105-4627-abaf-ec133484ca25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:58.115785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14195e-6105-4627-abaf-ec133484ca25 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:58.132916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 994/1968] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:18:58.137152 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215cdd-cad7-4089-8b2f-5f8d3b74d036 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:58.150716 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215cdd-cad7-4089-8b2f-5f8d3b74d036 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:58.156505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ae22d-e00e-4bac-b6f5-3d7d3f4fc8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:58.157212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ae22d-e00e-4bac-b6f5-3d7d3f4fc8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:58.157499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ae22d-e00e-4bac-b6f5-3d7d3f4fc8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:58.157780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ae22d-e00e-4bac-b6f5-3d7d3f4fc8e0 admin admin] PATH_INFO: `/v3/projects/847bac9200ae461c935037c5d48df8ff/users/857d96cd423342efb595164b8497d966/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:58.159730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ae22d-e00e-4bac-b6f5-3d7d3f4fc8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847bac9200ae461c935037c5d48df8ff, user_id=857d96cd423342efb595164b8497d966, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:58.163589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ae22d-e00e-4bac-b6f5-3d7d3f4fc8e0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:58.181783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 975/1969] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:18:58 2022] PUT /identity/v3/projects/847bac9200ae461c935037c5d48df8ff/users/857d96cd423342efb595164b8497d966/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:18:58.192175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64a006-30f8-46f7-a971-25575ee9dddf None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:58.192534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64a006-30f8-46f7-a971-25575ee9dddf None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:58.193354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64a006-30f8-46f7-a971-25575ee9dddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:58.235769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3d64a006-30f8-46f7-a971-25575ee9dddf None None] MFA Rules not processed for user `857d96cd423342efb595164b8497d966`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:18:58.237795 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3d64a006-30f8-46f7-a971-25575ee9dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:58.316261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 995/1970] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:18:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:18:58.527729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ae22d-e00e-4bac-b6f5-3d7d3f4fc8e0 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:18:58.534297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ed4ae22d-e00e-4bac-b6f5-3d7d3f4fc8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:18:58.604013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ae22d-e00e-4bac-b6f5-3d7d3f4fc8e0 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:18:58.608246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d29de-d6dd-41bb-b5df-21701d767d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:18:58.608868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d29de-d6dd-41bb-b5df-21701d767d5e service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:18:58.609147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d29de-d6dd-41bb-b5df-21701d767d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:18:58.609420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d29de-d6dd-41bb-b5df-21701d767d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:18:58.640526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:58.670531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d29de-d6dd-41bb-b5df-21701d767d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:18:58.673422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d29de-d6dd-41bb-b5df-21701d767d5e service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:18:58.682666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 976/1971] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:18:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:18:58.909113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:59.470687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:59.525982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:00.366322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:00.903331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:01.179028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:03.694896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64a006-30f8-46f7-a971-25575ee9dddf None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:03.696520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3d64a006-30f8-46f7-a971-25575ee9dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:03.779685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64a006-30f8-46f7-a971-25575ee9dddf None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:03.784206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:03.784847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:03.785111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:03.785381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] PATH_INFO: `/v3/users/9df44d7e1b874671aec8ee0ddfed403b` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:03.786572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df44d7e1b874671aec8ee0ddfed403b)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:03.788587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:04.025255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df44d7e1b874671aec8ee0ddfed403b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.025917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df44d7e1b874671aec8ee0ddfed403b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.127482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df44d7e1b874671aec8ee0ddfed403b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.128141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df44d7e1b874671aec8ee0ddfed403b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.136513 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df44d7e1b874671aec8ee0ddfed403b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.141415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:04.156986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 996/1972] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:03 2022] DELETE /identity/v3/users/9df44d7e1b874671aec8ee0ddfed403b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:04.399237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d29de-d6dd-41bb-b5df-21701d767d5e service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:04.401372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-730d29de-d6dd-41bb-b5df-21701d767d5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:04.404562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:04.407011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:04.420171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d29de-d6dd-41bb-b5df-21701d767d5e service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:04.489244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ef0ff-149b-405b-b278-0db467e6fbb7 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:04.493351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:04.493984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:04.494267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:04.494538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:04.496420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:04.497175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:04.497826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:04.498113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:04.500555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] PATH_INFO: `/v3/users/5db159b4a8bf49dd866e59d0453244f3` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:04.500555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db159b4a8bf49dd866e59d0453244f3)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:04.501490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:04.565530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:04.567033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:04.577018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 997/1973] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:04.580750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:04.580750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:04.594765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e8ea-938d-4a61-b976-f0895adebc33 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:04.600048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:04.600686 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:04.600974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:04.601253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] PATH_INFO: `/v3/projects/627acef0c9154338bcd5e8befe476cb1` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:04.602403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627acef0c9154338bcd5e8befe476cb1)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:04.604327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:04.791736 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db159b4a8bf49dd866e59d0453244f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.792633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627acef0c9154338bcd5e8befe476cb1', 'request_id': 'req-cf074454-19bb-4849-8cda-3d739af1c859'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.886149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db159b4a8bf49dd866e59d0453244f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.895211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:04.899892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db159b4a8bf49dd866e59d0453244f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.900585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db159b4a8bf49dd866e59d0453244f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.907562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e764d089-be9d-44b8-8921-31660ce1e17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db159b4a8bf49dd866e59d0453244f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.914244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 977/1974] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:04 2022] DELETE /identity/v3/users/5db159b4a8bf49dd866e59d0453244f3 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:04.918689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe605c-68bb-4350-a646-f3e85d5e854b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:04.918986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe605c-68bb-4350-a646-f3e85d5e854b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:04.919283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe605c-68bb-4350-a646-f3e85d5e854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:04.939771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-02fe605c-68bb-4350-a646-f3e85d5e854b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:04.940983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-02fe605c-68bb-4350-a646-f3e85d5e854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:04.985169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627acef0c9154338bcd5e8befe476cb1', 'request_id': 'req-cf074454-19bb-4849-8cda-3d739af1c859'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:04.993245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627acef0c9154338bcd5e8befe476cb1', 'request_id': 'req-cf074454-19bb-4849-8cda-3d739af1c859'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:05.005536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] The token cache is being invalidate because project 627acef0c9154338bcd5e8befe476cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:05.005908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:05.006618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:05.007643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 978/1975] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:05.011024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 998/1976] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:04 2022] DELETE /identity/v3/projects/627acef0c9154338bcd5e8befe476cb1 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:05.013750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf277-05bc-4e86-9374-69c981b0c606 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.014108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf277-05bc-4e86-9374-69c981b0c606 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.014527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf277-05bc-4e86-9374-69c981b0c606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.018743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:05.020259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:05.035695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-781cf277-05bc-4e86-9374-69c981b0c606 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:05.037209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-781cf277-05bc-4e86-9374-69c981b0c606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:05.049199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 979/1977] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:05.056971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a606e-d39f-4819-abfd-296fc2685929 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.057597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a606e-d39f-4819-abfd-296fc2685929 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.057876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a606e-d39f-4819-abfd-296fc2685929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.065155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:05.093452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ee1a606e-d39f-4819-abfd-296fc2685929 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:05.094996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ee1a606e-d39f-4819-abfd-296fc2685929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:05.110058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 980/1978] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:05.112631 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a606e-d39f-4819-abfd-296fc2685929 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:05.125563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a606e-d39f-4819-abfd-296fc2685929 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:05.133129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469699ae-fbfd-4aaa-bc30-d42245bfdc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:05.134019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469699ae-fbfd-4aaa-bc30-d42245bfdc19 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.134312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469699ae-fbfd-4aaa-bc30-d42245bfdc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.134824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469699ae-fbfd-4aaa-bc30-d42245bfdc19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.135710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469699ae-fbfd-4aaa-bc30-d42245bfdc19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:05.136032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469699ae-fbfd-4aaa-bc30-d42245bfdc19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:05.137755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf074454-19bb-4849-8cda-3d739af1c859 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:05.137884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469699ae-fbfd-4aaa-bc30-d42245bfdc19 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:05.152945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 981/1979] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:19:05.164173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469699ae-fbfd-4aaa-bc30-d42245bfdc19 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:05.175262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469699ae-fbfd-4aaa-bc30-d42245bfdc19 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:05.180618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fafee-7660-461b-92d1-81a000763899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:05.181264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fafee-7660-461b-92d1-81a000763899 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.181557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fafee-7660-461b-92d1-81a000763899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.181833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fafee-7660-461b-92d1-81a000763899 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.182465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fafee-7660-461b-92d1-81a000763899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:05.184393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fafee-7660-461b-92d1-81a000763899 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:05.199590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231c0d0-050e-4106-8faa-b66c47d4900a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:05.200576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c0d0-050e-4106-8faa-b66c47d4900a service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.200864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c0d0-050e-4106-8faa-b66c47d4900a service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.201137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c0d0-050e-4106-8faa-b66c47d4900a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.202922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5231c0d0-050e-4106-8faa-b66c47d4900a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:05.218040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231c0d0-050e-4106-8faa-b66c47d4900a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:05.219565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231c0d0-050e-4106-8faa-b66c47d4900a service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:05.230417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 999/1980] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:19:05.333494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 982/1981] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:05 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:05.337832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231c0d0-050e-4106-8faa-b66c47d4900a service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:05.347293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231c0d0-050e-4106-8faa-b66c47d4900a service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:05.435090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7f6da-001c-4c6e-9d72-479a8ad97e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:05.436446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7f6da-001c-4c6e-9d72-479a8ad97e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.448050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7f6da-001c-4c6e-9d72-479a8ad97e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.448050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7f6da-001c-4c6e-9d72-479a8ad97e88 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.448050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7f6da-001c-4c6e-9d72-479a8ad97e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:05.448050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7f6da-001c-4c6e-9d72-479a8ad97e88 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:05.657816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1000/1982] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:05 2022] POST /identity/v3/users => generated 295 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:05.662597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fafee-7660-461b-92d1-81a000763899 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:05.673055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fafee-7660-461b-92d1-81a000763899 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:05.678380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a234b6-e454-47cb-88b0-1353fee6cf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:05.680015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a234b6-e454-47cb-88b0-1353fee6cf8a admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.680015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a234b6-e454-47cb-88b0-1353fee6cf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.680015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a234b6-e454-47cb-88b0-1353fee6cf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.680246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a234b6-e454-47cb-88b0-1353fee6cf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:05.681779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a234b6-e454-47cb-88b0-1353fee6cf8a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:05.692355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 983/1983] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:05.698157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7f6da-001c-4c6e-9d72-479a8ad97e88 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:05.708969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7f6da-001c-4c6e-9d72-479a8ad97e88 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:05.713835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb182e-77e4-441c-9653-a1aeec88603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:05.714443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb182e-77e4-441c-9653-a1aeec88603d admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.714726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb182e-77e4-441c-9653-a1aeec88603d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.715014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb182e-77e4-441c-9653-a1aeec88603d admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.715702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb182e-77e4-441c-9653-a1aeec88603d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:05.717301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb182e-77e4-441c-9653-a1aeec88603d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:05.727840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1001/1984] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:05.743163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a234b6-e454-47cb-88b0-1353fee6cf8a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:05.753729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a234b6-e454-47cb-88b0-1353fee6cf8a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:05.758450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22450cc5-473d-4d3e-97d1-ea68a8be591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:05.767774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22450cc5-473d-4d3e-97d1-ea68a8be591a admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.768076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22450cc5-473d-4d3e-97d1-ea68a8be591a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.768442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22450cc5-473d-4d3e-97d1-ea68a8be591a admin admin] PATH_INFO: `/v3/projects/07392db69f6942fdbc6a05fad194926b/users/22369962f4954442ab2b873499889d39/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.770402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb182e-77e4-441c-9653-a1aeec88603d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:05.775275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2ebb182e-77e4-441c-9653-a1aeec88603d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:05.789665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22450cc5-473d-4d3e-97d1-ea68a8be591a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07392db69f6942fdbc6a05fad194926b, user_id=22369962f4954442ab2b873499889d39, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:05.793218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22450cc5-473d-4d3e-97d1-ea68a8be591a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:05.795679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb182e-77e4-441c-9653-a1aeec88603d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:05.804802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:05.809130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.809130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.809130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] PATH_INFO: `/v3/projects/9f2f608f3250438ab525b7d0b476266c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.809130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2f608f3250438ab525b7d0b476266c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:05.812048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:05.870050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 984/1985] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:05 2022] PUT /identity/v3/projects/07392db69f6942fdbc6a05fad194926b/users/22369962f4954442ab2b873499889d39/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:05.875043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c62ba7-ef32-4d79-a463-1e03b84f58ce None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:05.875331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c62ba7-ef32-4d79-a463-1e03b84f58ce None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:05.875609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c62ba7-ef32-4d79-a463-1e03b84f58ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:05.895235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-02c62ba7-ef32-4d79-a463-1e03b84f58ce None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:05.897087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-02c62ba7-ef32-4d79-a463-1e03b84f58ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:05.964259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2f608f3250438ab525b7d0b476266c', 'request_id': 'req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:05.967256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:05.968748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:05.979466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 985/1986] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:05.993997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c62ba7-ef32-4d79-a463-1e03b84f58ce None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:05.993997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-02c62ba7-ef32-4d79-a463-1e03b84f58ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:06.053639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c62ba7-ef32-4d79-a463-1e03b84f58ce None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:06.108646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d7b0a-3dbd-4bc7-a6bc-c8eb50e82701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:06.109260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d7b0a-3dbd-4bc7-a6bc-c8eb50e82701 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:06.109546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d7b0a-3dbd-4bc7-a6bc-c8eb50e82701 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:06.109825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d7b0a-3dbd-4bc7-a6bc-c8eb50e82701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:06.113761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2f608f3250438ab525b7d0b476266c', 'request_id': 'req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:06.122046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2f608f3250438ab525b7d0b476266c', 'request_id': 'req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:06.134068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] The token cache is being invalidate because project 9f2f608f3250438ab525b7d0b476266c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:06.134565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:06.135205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:06.136761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1002/1987] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:05 2022] DELETE /identity/v3/projects/9f2f608f3250438ab525b7d0b476266c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:06.141115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:06.142549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:06.176988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d7b0a-3dbd-4bc7-a6bc-c8eb50e82701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:06.178428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d7b0a-3dbd-4bc7-a6bc-c8eb50e82701 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:06.188074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 986/1988] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:06.219539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a66b8-e1ad-4934-8c62-daf880d0b6bc admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:06.226033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:06.226679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:06.226962 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:06.227373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] PATH_INFO: `/v3/users/fa03b439c33a4b298d1a730d1c1e972b` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:06.228562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa03b439c33a4b298d1a730d1c1e972b)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:06.230465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:06.447191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa03b439c33a4b298d1a730d1c1e972b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:06.447917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa03b439c33a4b298d1a730d1c1e972b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:06.502395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa03b439c33a4b298d1a730d1c1e972b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:06.503090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa03b439c33a4b298d1a730d1c1e972b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:06.511501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa03b439c33a4b298d1a730d1c1e972b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:06.530017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1003/1989] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:06 2022] DELETE /identity/v3/users/fa03b439c33a4b298d1a730d1c1e972b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:07.002424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d7b0a-3dbd-4bc7-a6bc-c8eb50e82701 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:07.013436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d7b0a-3dbd-4bc7-a6bc-c8eb50e82701 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:07.083405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:07.084285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.084677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.085174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] PATH_INFO: `/v3/projects/6fb95e19aaa948478060a0b7684768de` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.086528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb95e19aaa948478060a0b7684768de)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:07.088674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:07.192532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:07.196182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:07.196182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:07.213997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d622fbf-9a02-4f13-af52-bf778fd91942 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:07.214255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb95e19aaa948478060a0b7684768de', 'request_id': 'req-2586f893-e2aa-4419-954f-7ab455e2a3c4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.221946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb95e19aaa948478060a0b7684768de', 'request_id': 'req-2586f893-e2aa-4419-954f-7ab455e2a3c4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.284841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:07.291162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:07.291845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.292127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.292408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] PATH_INFO: `/v3/users/9af76efc7fc046e09c76870fbc1573cb` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.293526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af76efc7fc046e09c76870fbc1573cb)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:07.295434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:07.348099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb95e19aaa948478060a0b7684768de', 'request_id': 'req-2586f893-e2aa-4419-954f-7ab455e2a3c4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.360982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] The token cache is being invalidate because project 6fb95e19aaa948478060a0b7684768de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:07.361275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.361933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2586f893-e2aa-4419-954f-7ab455e2a3c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.363439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 987/1990] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:07 2022] DELETE /identity/v3/projects/6fb95e19aaa948478060a0b7684768de => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:07.368935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0993-860f-4c13-b4a9-bccd02dcca7d None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.369243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0993-860f-4c13-b4a9-bccd02dcca7d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.369613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0993-860f-4c13-b4a9-bccd02dcca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.391479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-3caf0993-860f-4c13-b4a9-bccd02dcca7d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:07.392850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3caf0993-860f-4c13-b4a9-bccd02dcca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:07.401558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 988/1991] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:07.411981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96c118-224f-40f3-a108-6556b7561d1c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.414157 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96c118-224f-40f3-a108-6556b7561d1c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.414420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96c118-224f-40f3-a108-6556b7561d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.434849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ae96c118-224f-40f3-a108-6556b7561d1c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:07.436108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ae96c118-224f-40f3-a108-6556b7561d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:07.444261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 989/1992] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:07.448787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96c118-224f-40f3-a108-6556b7561d1c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:07.460089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96c118-224f-40f3-a108-6556b7561d1c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:07.465637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9ba7-60f0-4493-a61a-af12d20d701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:07.466276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9ba7-60f0-4493-a61a-af12d20d701e admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.466619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9ba7-60f0-4493-a61a-af12d20d701e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.466897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9ba7-60f0-4493-a61a-af12d20d701e admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.467604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a9ba7-60f0-4493-a61a-af12d20d701e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:07.468008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a9ba7-60f0-4493-a61a-af12d20d701e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:07.469854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a9ba7-60f0-4493-a61a-af12d20d701e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:07.479490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af76efc7fc046e09c76870fbc1573cb'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.480341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af76efc7fc046e09c76870fbc1573cb'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.483424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 990/1993] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:19:07.488166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9ba7-60f0-4493-a61a-af12d20d701e admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:07.498845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9ba7-60f0-4493-a61a-af12d20d701e admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:07.504258 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82eff-6738-4ba0-ae6f-815f3d63ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:07.504843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82eff-6738-4ba0-ae6f-815f3d63ad87 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.505155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82eff-6738-4ba0-ae6f-815f3d63ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.505433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82eff-6738-4ba0-ae6f-815f3d63ad87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.506067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d82eff-6738-4ba0-ae6f-815f3d63ad87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:07.508033 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d82eff-6738-4ba0-ae6f-815f3d63ad87 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:07.571323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af76efc7fc046e09c76870fbc1573cb'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.571997 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af76efc7fc046e09c76870fbc1573cb'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.582664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-284dc763-a387-4021-82e1-a3db229467d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af76efc7fc046e09c76870fbc1573cb'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:07.602504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1004/1994] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:07 2022] DELETE /identity/v3/users/9af76efc7fc046e09c76870fbc1573cb => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:19:07.606598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4dcba-801b-4639-b95e-370949f0d971 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.606957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4dcba-801b-4639-b95e-370949f0d971 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.607315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4dcba-801b-4639-b95e-370949f0d971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.626987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-35f4dcba-801b-4639-b95e-370949f0d971 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:07.628361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-35f4dcba-801b-4639-b95e-370949f0d971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:07.630888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 991/1995] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:07 2022] POST /identity/v3/projects => generated 355 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:07.631687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82eff-6738-4ba0-ae6f-815f3d63ad87 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:07.634677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-95d82eff-6738-4ba0-ae6f-815f3d63ad87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:07.690967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1005/1996] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:07.701060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4dcba-801b-4639-b95e-370949f0d971 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:07.704013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82eff-6738-4ba0-ae6f-815f3d63ad87 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:07.713918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-35f4dcba-801b-4639-b95e-370949f0d971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:07.727842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fa95c-ce8a-4f97-98d8-a643f741f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:07.727842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fa95c-ce8a-4f97-98d8-a643f741f394 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.727842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fa95c-ce8a-4f97-98d8-a643f741f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.727842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fa95c-ce8a-4f97-98d8-a643f741f394 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.728432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fa95c-ce8a-4f97-98d8-a643f741f394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:07.728432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fa95c-ce8a-4f97-98d8-a643f741f394 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:07.809515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4dcba-801b-4639-b95e-370949f0d971 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:07.813215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceb93d-066a-4683-aa63-3b08f8a5353b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:07.813857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceb93d-066a-4683-aa63-3b08f8a5353b service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.814143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceb93d-066a-4683-aa63-3b08f8a5353b service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.814421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceb93d-066a-4683-aa63-3b08f8a5353b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.826989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ceb93d-066a-4683-aa63-3b08f8a5353b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:07.826989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ceb93d-066a-4683-aa63-3b08f8a5353b service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:07.839271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1006/1997] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:19:07.853028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 992/1998] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:07 2022] POST /identity/v3/users => generated 278 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:07.860220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceb93d-066a-4683-aa63-3b08f8a5353b service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:07.873262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceb93d-066a-4683-aa63-3b08f8a5353b service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:07.878438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bd34f-c5fc-4e12-bd5a-08b620d34369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:07.879112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bd34f-c5fc-4e12-bd5a-08b620d34369 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.879472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bd34f-c5fc-4e12-bd5a-08b620d34369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.879726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bd34f-c5fc-4e12-bd5a-08b620d34369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.880979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bd34f-c5fc-4e12-bd5a-08b620d34369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:07.882883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bd34f-c5fc-4e12-bd5a-08b620d34369 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:07.899784 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1007/1999] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:07.904159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fa95c-ce8a-4f97-98d8-a643f741f394 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:07.916712 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fa95c-ce8a-4f97-98d8-a643f741f394 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:07.932591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81669d3c-c771-40c1-ba2d-2bd12f9c9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:07.935676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81669d3c-c771-40c1-ba2d-2bd12f9c9507 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.935676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81669d3c-c771-40c1-ba2d-2bd12f9c9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.935676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81669d3c-c771-40c1-ba2d-2bd12f9c9507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.935676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81669d3c-c771-40c1-ba2d-2bd12f9c9507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:07.937573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81669d3c-c771-40c1-ba2d-2bd12f9c9507 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:07.960672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 993/2000] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:07.964779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bd34f-c5fc-4e12-bd5a-08b620d34369 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:07.975469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bd34f-c5fc-4e12-bd5a-08b620d34369 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:07.982561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be6dab-4257-4c26-acc8-840c73baf807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:07.983246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be6dab-4257-4c26-acc8-840c73baf807 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:07.983598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be6dab-4257-4c26-acc8-840c73baf807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:07.983914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be6dab-4257-4c26-acc8-840c73baf807 admin admin] PATH_INFO: `/v3/projects/056968710b5b4e7681ac755d0fc9f1d6/users/832577e80cfc4767902edd71f83e711f/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:07.999570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be6dab-4257-4c26-acc8-840c73baf807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056968710b5b4e7681ac755d0fc9f1d6, user_id=832577e80cfc4767902edd71f83e711f, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:08.002237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be6dab-4257-4c26-acc8-840c73baf807 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:08.104615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1008/2001] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:07 2022] PUT /identity/v3/projects/056968710b5b4e7681ac755d0fc9f1d6/users/832577e80cfc4767902edd71f83e711f/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:08.117934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026e37-8d74-4683-b7e4-8f11b72a3231 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.118491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026e37-8d74-4683-b7e4-8f11b72a3231 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.118784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026e37-8d74-4683-b7e4-8f11b72a3231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.152275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-70026e37-8d74-4683-b7e4-8f11b72a3231 None None] MFA Rules not processed for user `832577e80cfc4767902edd71f83e711f`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:08.153594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-70026e37-8d74-4683-b7e4-8f11b72a3231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:08.169024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:08.236622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 994/2002] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:08.242448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be6dab-4257-4c26-acc8-840c73baf807 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:08.338982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026e37-8d74-4683-b7e4-8f11b72a3231 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:08.341161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-70026e37-8d74-4683-b7e4-8f11b72a3231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:08.357010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be6dab-4257-4c26-acc8-840c73baf807 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:08.367691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735fa0-56cd-404b-a4a8-58bc568af2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:08.368789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735fa0-56cd-404b-a4a8-58bc568af2be admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.369359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735fa0-56cd-404b-a4a8-58bc568af2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.369837 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735fa0-56cd-404b-a4a8-58bc568af2be admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.371349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2735fa0-56cd-404b-a4a8-58bc568af2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:08.372657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026e37-8d74-4683-b7e4-8f11b72a3231 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:08.375774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2735fa0-56cd-404b-a4a8-58bc568af2be admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:08.386426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:08.387345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.387814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.388258 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] PATH_INFO: `/v3/projects/dbb5a97cc7de41a5ab6da8a9a2baab2b` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.394550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb5a97cc7de41a5ab6da8a9a2baab2b)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:08.396618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:08.494372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1009/2003] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:08 2022] POST /identity/v3/projects => generated 355 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:08.495944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735fa0-56cd-404b-a4a8-58bc568af2be admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:08.548038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb5a97cc7de41a5ab6da8a9a2baab2b', 'request_id': 'req-ef496fe2-94a6-447f-9647-3dd28a51d2a2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:08.565391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb5a97cc7de41a5ab6da8a9a2baab2b', 'request_id': 'req-ef496fe2-94a6-447f-9647-3dd28a51d2a2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:08.574172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735fa0-56cd-404b-a4a8-58bc568af2be admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:08.642384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a5ede-ce7b-406d-a157-abeb946522e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:08.643113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a5ede-ce7b-406d-a157-abeb946522e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.643418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a5ede-ce7b-406d-a157-abeb946522e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.645505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a5ede-ce7b-406d-a157-abeb946522e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.646280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a5ede-ce7b-406d-a157-abeb946522e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:08.648330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a5ede-ce7b-406d-a157-abeb946522e4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:08.703516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb5a97cc7de41a5ab6da8a9a2baab2b', 'request_id': 'req-ef496fe2-94a6-447f-9647-3dd28a51d2a2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:08.717252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] The token cache is being invalidate because project dbb5a97cc7de41a5ab6da8a9a2baab2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:08.717641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:08.718416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ef496fe2-94a6-447f-9647-3dd28a51d2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:08.720428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 995/2004] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:08 2022] DELETE /identity/v3/projects/dbb5a97cc7de41a5ab6da8a9a2baab2b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:08.726817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432465d4-590c-4ef7-8731-aa774896de5b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.727442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432465d4-590c-4ef7-8731-aa774896de5b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.727930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432465d4-590c-4ef7-8731-aa774896de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.751184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-432465d4-590c-4ef7-8731-aa774896de5b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:08.752582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-432465d4-590c-4ef7-8731-aa774896de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:08.756999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1010/2005] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:08 2022] POST /identity/v3/users => generated 284 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:08.761149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a5ede-ce7b-406d-a157-abeb946522e4 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:08.763032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5f1a5ede-ce7b-406d-a157-abeb946522e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:08.771500 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 996/2006] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:08.773108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c39f7-54a7-4e29-b2b0-11cd773c92ff None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.773548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c39f7-54a7-4e29-b2b0-11cd773c92ff None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.773830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c39f7-54a7-4e29-b2b0-11cd773c92ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.779105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a5ede-ce7b-406d-a157-abeb946522e4 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:08.786758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a85fb-6e75-418e-be6b-309cd5b9dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:08.787706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a85fb-6e75-418e-be6b-309cd5b9dfcb admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.788782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a85fb-6e75-418e-be6b-309cd5b9dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.789233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a85fb-6e75-418e-be6b-309cd5b9dfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.790086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a85fb-6e75-418e-be6b-309cd5b9dfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:08.791896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a85fb-6e75-418e-be6b-309cd5b9dfcb admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:08.810545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1011/2007] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:19:08.814766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a85fb-6e75-418e-be6b-309cd5b9dfcb admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:08.819929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-223c39f7-54a7-4e29-b2b0-11cd773c92ff None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:08.821477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-223c39f7-54a7-4e29-b2b0-11cd773c92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:08.828053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a85fb-6e75-418e-be6b-309cd5b9dfcb admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:08.833936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd76cb-a969-4d35-b323-eb8215ef8213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:08.834908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd76cb-a969-4d35-b323-eb8215ef8213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.835478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd76cb-a969-4d35-b323-eb8215ef8213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.835980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 997/2008] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:08.839810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd76cb-a969-4d35-b323-eb8215ef8213 admin admin] PATH_INFO: `/v3/projects/3c3b41f719a64860bf162d90ff81ddcf/users/6926fc444e244bf99b2437857882bc0d/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.840062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c39f7-54a7-4e29-b2b0-11cd773c92ff None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:08.856095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c39f7-54a7-4e29-b2b0-11cd773c92ff None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:08.864541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01175527-a5f2-4bef-b525-a25d2c7fb211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:08.865680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01175527-a5f2-4bef-b525-a25d2c7fb211 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.865964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01175527-a5f2-4bef-b525-a25d2c7fb211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.866240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01175527-a5f2-4bef-b525-a25d2c7fb211 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.866343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd76cb-a969-4d35-b323-eb8215ef8213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c3b41f719a64860bf162d90ff81ddcf, user_id=6926fc444e244bf99b2437857882bc0d, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:08.866898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01175527-a5f2-4bef-b525-a25d2c7fb211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:08.867195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01175527-a5f2-4bef-b525-a25d2c7fb211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:08.869483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01175527-a5f2-4bef-b525-a25d2c7fb211 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:08.870340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd76cb-a969-4d35-b323-eb8215ef8213 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:08.877473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:08.889585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 998/2009] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:19:08.893919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01175527-a5f2-4bef-b525-a25d2c7fb211 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:08.912022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01175527-a5f2-4bef-b525-a25d2c7fb211 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:08.918983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8e6bd-b215-4d21-baf7-ad134fdc2b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:08.919654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8e6bd-b215-4d21-baf7-ad134fdc2b28 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:08.919995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8e6bd-b215-4d21-baf7-ad134fdc2b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:08.920276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8e6bd-b215-4d21-baf7-ad134fdc2b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:08.921151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8e6bd-b215-4d21-baf7-ad134fdc2b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:08.924227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8e6bd-b215-4d21-baf7-ad134fdc2b28 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:08.992474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1012/2010] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:08 2022] PUT /identity/v3/projects/3c3b41f719a64860bf162d90ff81ddcf/users/6926fc444e244bf99b2437857882bc0d/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:08.995780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd76cb-a969-4d35-b323-eb8215ef8213 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:09.102382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 999/2011] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:08 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:09.107701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8e6bd-b215-4d21-baf7-ad134fdc2b28 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:09.110906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd76cb-a969-4d35-b323-eb8215ef8213 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:09.209176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8077-d08e-4f31-9979-68387cf6898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:09.209902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8077-d08e-4f31-9979-68387cf6898c admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.210186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8077-d08e-4f31-9979-68387cf6898c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.210462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8077-d08e-4f31-9979-68387cf6898c admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.211121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c8077-d08e-4f31-9979-68387cf6898c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:09.213885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c8077-d08e-4f31-9979-68387cf6898c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:09.220873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8e6bd-b215-4d21-baf7-ad134fdc2b28 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:09.229831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35255d-5e0f-4a08-b82a-91e121c1313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:09.230333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1013/2012] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:19:09.232250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35255d-5e0f-4a08-b82a-91e121c1313d admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.232934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35255d-5e0f-4a08-b82a-91e121c1313d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.233311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35255d-5e0f-4a08-b82a-91e121c1313d admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.234061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35255d-5e0f-4a08-b82a-91e121c1313d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:09.235297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8077-d08e-4f31-9979-68387cf6898c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:09.236187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35255d-5e0f-4a08-b82a-91e121c1313d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:09.246963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8077-d08e-4f31-9979-68387cf6898c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:09.254063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32deee-eb75-42bc-9817-54cbca67bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:09.254773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32deee-eb75-42bc-9817-54cbca67bec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.260158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32deee-eb75-42bc-9817-54cbca67bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.260567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32deee-eb75-42bc-9817-54cbca67bec8 admin admin] PATH_INFO: `/v3/projects/3c3b41f719a64860bf162d90ff81ddcf/users/6926fc444e244bf99b2437857882bc0d/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.263415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32deee-eb75-42bc-9817-54cbca67bec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c3b41f719a64860bf162d90ff81ddcf, user_id=6926fc444e244bf99b2437857882bc0d, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:09.266247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32deee-eb75-42bc-9817-54cbca67bec8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:09.280255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1014/2013] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:09 2022] PUT /identity/v3/projects/3c3b41f719a64860bf162d90ff81ddcf/users/6926fc444e244bf99b2437857882bc0d/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:19:09.290569 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328d2f-e432-4ee4-80a0-dbd2663a9ba6 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.290859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328d2f-e432-4ee4-80a0-dbd2663a9ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.291128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328d2f-e432-4ee4-80a0-dbd2663a9ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.322573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4b328d2f-e432-4ee4-80a0-dbd2663a9ba6 None None] MFA Rules not processed for user `6926fc444e244bf99b2437857882bc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:09.323822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4b328d2f-e432-4ee4-80a0-dbd2663a9ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:09.339877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1000/2014] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:09 2022] POST /identity/v3/users => generated 282 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:09.343556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35255d-5e0f-4a08-b82a-91e121c1313d admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:09.354159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35255d-5e0f-4a08-b82a-91e121c1313d admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:09.410583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1015/2015] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:09.417105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb89f3-cad0-412a-ac6d-746789fd3174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:09.417935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb89f3-cad0-412a-ac6d-746789fd3174 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.418657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb89f3-cad0-412a-ac6d-746789fd3174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.419108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb89f3-cad0-412a-ac6d-746789fd3174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.419784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb89f3-cad0-412a-ac6d-746789fd3174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:09.421864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb89f3-cad0-412a-ac6d-746789fd3174 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:09.429040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b328d2f-e432-4ee4-80a0-dbd2663a9ba6 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:09.430779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4b328d2f-e432-4ee4-80a0-dbd2663a9ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:09.434323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1001/2016] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:19:09.440709 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb89f3-cad0-412a-ac6d-746789fd3174 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:09.462153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb89f3-cad0-412a-ac6d-746789fd3174 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:09.467885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4493041-3fcf-4f57-9873-e9bdd5d08985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:09.468632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493041-3fcf-4f57-9873-e9bdd5d08985 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.468987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493041-3fcf-4f57-9873-e9bdd5d08985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.469336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493041-3fcf-4f57-9873-e9bdd5d08985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.470063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4493041-3fcf-4f57-9873-e9bdd5d08985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:09.471935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4493041-3fcf-4f57-9873-e9bdd5d08985 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:09.493588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1002/2017] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:09.494361 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4493041-3fcf-4f57-9873-e9bdd5d08985 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:09.511924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4493041-3fcf-4f57-9873-e9bdd5d08985 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:09.519849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed57a1-70e5-49dd-9ec6-041df71e9272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:09.521455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b328d2f-e432-4ee4-80a0-dbd2663a9ba6 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:09.521591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed57a1-70e5-49dd-9ec6-041df71e9272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.522099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed57a1-70e5-49dd-9ec6-041df71e9272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.522624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed57a1-70e5-49dd-9ec6-041df71e9272 admin admin] PATH_INFO: `/v3/projects/5cff2672d87b41929edf10cc098af3b6/users/e3345f6aba4c4e1aba1c094d032a9ae9/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.527728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b922931-096a-4ad6-8fb7-e890a7832762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:09.528545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b922931-096a-4ad6-8fb7-e890a7832762 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.528931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b922931-096a-4ad6-8fb7-e890a7832762 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.529282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b922931-096a-4ad6-8fb7-e890a7832762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.546191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b922931-096a-4ad6-8fb7-e890a7832762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:09.548852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b922931-096a-4ad6-8fb7-e890a7832762 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:09.553338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed57a1-70e5-49dd-9ec6-041df71e9272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cff2672d87b41929edf10cc098af3b6, user_id=e3345f6aba4c4e1aba1c094d032a9ae9, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:09.558029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed57a1-70e5-49dd-9ec6-041df71e9272 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:09.565053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1016/2018] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:09.619154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1003/2019] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:09 2022] PUT /identity/v3/projects/5cff2672d87b41929edf10cc098af3b6/users/e3345f6aba4c4e1aba1c094d032a9ae9/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:09.631664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0623c-e95f-4eab-ad0e-722b29857b93 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.632006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0623c-e95f-4eab-ad0e-722b29857b93 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.632234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0623c-e95f-4eab-ad0e-722b29857b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.677644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2fc0623c-e95f-4eab-ad0e-722b29857b93 None None] MFA Rules not processed for user `e3345f6aba4c4e1aba1c094d032a9ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:09.679060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2fc0623c-e95f-4eab-ad0e-722b29857b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:09.757452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1017/2020] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:09.765338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed57a1-70e5-49dd-9ec6-041df71e9272 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:09.767351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e6ed57a1-70e5-49dd-9ec6-041df71e9272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:09.840926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed57a1-70e5-49dd-9ec6-041df71e9272 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:09.845245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e12d8a-9a6c-4eb1-8ec5-cc1d3ac8d605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:09.846082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e12d8a-9a6c-4eb1-8ec5-cc1d3ac8d605 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.846360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e12d8a-9a6c-4eb1-8ec5-cc1d3ac8d605 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.846657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e12d8a-9a6c-4eb1-8ec5-cc1d3ac8d605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.855930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e12d8a-9a6c-4eb1-8ec5-cc1d3ac8d605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:09.857482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e12d8a-9a6c-4eb1-8ec5-cc1d3ac8d605 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:09.867613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1004/2021] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:09.958866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0623c-e95f-4eab-ad0e-722b29857b93 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:09.971807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0623c-e95f-4eab-ad0e-722b29857b93 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:09.978534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354fe18-95ea-471c-bd4e-1d7debc5ff65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:09.979414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354fe18-95ea-471c-bd4e-1d7debc5ff65 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:09.979892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354fe18-95ea-471c-bd4e-1d7debc5ff65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:09.980466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354fe18-95ea-471c-bd4e-1d7debc5ff65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:09.983673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c354fe18-95ea-471c-bd4e-1d7debc5ff65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:10.074929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354fe18-95ea-471c-bd4e-1d7debc5ff65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:10.076457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354fe18-95ea-471c-bd4e-1d7debc5ff65 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:10.089480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1018/2022] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:10.139565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:10.570245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e12d8a-9a6c-4eb1-8ec5-cc1d3ac8d605 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:10.572084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-68e12d8a-9a6c-4eb1-8ec5-cc1d3ac8d605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:10.672185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e12d8a-9a6c-4eb1-8ec5-cc1d3ac8d605 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:10.677837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:10.679137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:10.679137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:10.679369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] PATH_INFO: `/v3/users/c840d8e55c4e408ba892d6fb1410b563` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:10.680720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c840d8e55c4e408ba892d6fb1410b563)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:10.683708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:10.823584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:11.007890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c840d8e55c4e408ba892d6fb1410b563'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:11.097295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c840d8e55c4e408ba892d6fb1410b563'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:11.127335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c840d8e55c4e408ba892d6fb1410b563'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:11.128174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c840d8e55c4e408ba892d6fb1410b563'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:11.152995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c840d8e55c4e408ba892d6fb1410b563'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:11.160930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1005/2023] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:10 2022] DELETE /identity/v3/users/c840d8e55c4e408ba892d6fb1410b563 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:11.166685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a159f-5e2d-46e7-af8d-e0ac524c118e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:11.166977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a159f-5e2d-46e7-af8d-e0ac524c118e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:11.167430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a159f-5e2d-46e7-af8d-e0ac524c118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:11.188266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b50a159f-5e2d-46e7-af8d-e0ac524c118e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:11.189653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b50a159f-5e2d-46e7-af8d-e0ac524c118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:11.267742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1019/2024] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:11.276670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:11.288640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:11.456459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7996-67c7-48fc-8fe5-9f8b7c4d3b72 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:11.456459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d8513-b33e-4c52-90a0-df29a80d182f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:11.456459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8513-b33e-4c52-90a0-df29a80d182f service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:11.456459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8513-b33e-4c52-90a0-df29a80d182f service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:11.457313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8513-b33e-4c52-90a0-df29a80d182f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:11.457313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8513-b33e-4c52-90a0-df29a80d182f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:11.457313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8513-b33e-4c52-90a0-df29a80d182f service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:11.457313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1006/2025] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:11.984078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a159f-5e2d-46e7-af8d-e0ac524c118e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:11.986286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b50a159f-5e2d-46e7-af8d-e0ac524c118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:12.015967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a159f-5e2d-46e7-af8d-e0ac524c118e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:12.030717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:12.031424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:12.031914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:12.032202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] PATH_INFO: `/v3/projects/0ea696cda4704b39bf3c63781f2e207c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:12.033478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea696cda4704b39bf3c63781f2e207c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:12.035471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:12.250892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea696cda4704b39bf3c63781f2e207c', 'request_id': 'req-3be64519-e271-47f9-a9dd-03185ef9db27'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.353692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d8513-b33e-4c52-90a0-df29a80d182f service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:12.356396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-714d8513-b33e-4c52-90a0-df29a80d182f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:12.372355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea696cda4704b39bf3c63781f2e207c', 'request_id': 'req-3be64519-e271-47f9-a9dd-03185ef9db27'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.372611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d8513-b33e-4c52-90a0-df29a80d182f service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:12.380406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea696cda4704b39bf3c63781f2e207c', 'request_id': 'req-3be64519-e271-47f9-a9dd-03185ef9db27'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.391872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] The token cache is being invalidate because project 0ea696cda4704b39bf3c63781f2e207c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:12.392479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.393434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.396253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1020/2026] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:11 2022] DELETE /identity/v3/projects/0ea696cda4704b39bf3c63781f2e207c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:12.400781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:12.403420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:12.461567 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:12.462968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:12.464264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:12.464555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] PATH_INFO: `/v3/users/81e5b2e9ebc942cba33269302c60248d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:12.465777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e5b2e9ebc942cba33269302c60248d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:12.468264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:12.501305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be64519-e271-47f9-a9dd-03185ef9db27 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:12.506606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:12.507520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:12.507845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:12.508123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] PATH_INFO: `/v3/users/857d96cd423342efb595164b8497d966` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:12.511796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857d96cd423342efb595164b8497d966)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:12.511796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:12.712520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e5b2e9ebc942cba33269302c60248d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.755909 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857d96cd423342efb595164b8497d966'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.761343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857d96cd423342efb595164b8497d966'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.832035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e5b2e9ebc942cba33269302c60248d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.850632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e5b2e9ebc942cba33269302c60248d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.851905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e5b2e9ebc942cba33269302c60248d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.863533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4ad1cc30-1490-4908-92c1-4cc3a0616ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e5b2e9ebc942cba33269302c60248d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.881185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1007/2027] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:12 2022] DELETE /identity/v3/users/81e5b2e9ebc942cba33269302c60248d => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:19:12.886688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0dc04-9533-4a07-b5d0-51b7913a88a6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:12.886688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0dc04-9533-4a07-b5d0-51b7913a88a6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:12.886954 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0dc04-9533-4a07-b5d0-51b7913a88a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:12.921065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-02c0dc04-9533-4a07-b5d0-51b7913a88a6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:12.921065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-02c0dc04-9533-4a07-b5d0-51b7913a88a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:12.949082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857d96cd423342efb595164b8497d966'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.949820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857d96cd423342efb595164b8497d966'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.960753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857d96cd423342efb595164b8497d966'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:12.982934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:13.004634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1021/2028] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:12 2022] DELETE /identity/v3/users/857d96cd423342efb595164b8497d966 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:13.021978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1008/2029] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:13.035409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:13.038098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:13.139926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a3fba-1aef-4391-b9eb-e2c3e875e186 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:13.154397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967520a4-7e88-4da2-96b5-10dc8d128be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:13.156290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967520a4-7e88-4da2-96b5-10dc8d128be0 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:13.156681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967520a4-7e88-4da2-96b5-10dc8d128be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:13.157103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967520a4-7e88-4da2-96b5-10dc8d128be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:13.277851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967520a4-7e88-4da2-96b5-10dc8d128be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:13.279467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967520a4-7e88-4da2-96b5-10dc8d128be0 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:13.292286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68e72-f5d5-4869-b6f7-d992ef8e6527 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:13.292859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68e72-f5d5-4869-b6f7-d992ef8e6527 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:13.293335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68e72-f5d5-4869-b6f7-d992ef8e6527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:13.302988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1022/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:13.334310 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:13.340578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-afc68e72-f5d5-4869-b6f7-d992ef8e6527 None None] MFA Rules not processed for user `22369962f4954442ab2b873499889d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:13.340578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-afc68e72-f5d5-4869-b6f7-d992ef8e6527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:13.455958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1009/2031] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:13.473166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967520a4-7e88-4da2-96b5-10dc8d128be0 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:13.475346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-967520a4-7e88-4da2-96b5-10dc8d128be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:13.568209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967520a4-7e88-4da2-96b5-10dc8d128be0 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:13.573927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a04ae-4735-44ae-9529-8384496d0758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:13.576416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a04ae-4735-44ae-9529-8384496d0758 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:13.576416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a04ae-4735-44ae-9529-8384496d0758 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:13.576416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a04ae-4735-44ae-9529-8384496d0758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:13.596288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a04ae-4735-44ae-9529-8384496d0758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:13.600282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a04ae-4735-44ae-9529-8384496d0758 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:13.618591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1023/2032] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:13.674048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68e72-f5d5-4869-b6f7-d992ef8e6527 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:13.676117 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-afc68e72-f5d5-4869-b6f7-d992ef8e6527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:13.717105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68e72-f5d5-4869-b6f7-d992ef8e6527 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:13.724900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:13.725256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:13.725380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:13.725657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] PATH_INFO: `/v3/projects/847bac9200ae461c935037c5d48df8ff` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:13.728226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847bac9200ae461c935037c5d48df8ff)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:13.730266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:13.887449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847bac9200ae461c935037c5d48df8ff', 'request_id': 'req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:13.889152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a04ae-4735-44ae-9529-8384496d0758 service nova] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:13.890714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c83a04ae-4735-44ae-9529-8384496d0758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:13.896365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847bac9200ae461c935037c5d48df8ff', 'request_id': 'req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:13.908819 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a04ae-4735-44ae-9529-8384496d0758 service nova] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:13.944549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847bac9200ae461c935037c5d48df8ff', 'request_id': 'req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:13.974862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] The token cache is being invalidate because project 847bac9200ae461c935037c5d48df8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:13.976130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:13.978593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9744f4fb-7170-4a1e-a3f5-f383ae5c5d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:13.988446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1010/2033] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:13 2022] DELETE /identity/v3/projects/847bac9200ae461c935037c5d48df8ff => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:13.990935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbf1f8-0b73-479e-9b95-ac7031416103 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:13.993429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbf1f8-0b73-479e-9b95-ac7031416103 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:13.993429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbf1f8-0b73-479e-9b95-ac7031416103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.026870 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.028361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.028825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.029713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] PATH_INFO: `/v3/projects/196cf7bb302d4a6cb3a235386b3446a8` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.031243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196cf7bb302d4a6cb3a235386b3446a8)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.033238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.044250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-2dcbf1f8-0b73-479e-9b95-ac7031416103 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:14.045070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2dcbf1f8-0b73-479e-9b95-ac7031416103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:14.054479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1011/2034] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:14.064459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd81ce-1804-4b03-aa1e-bcc41c2d781a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.064754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd81ce-1804-4b03-aa1e-bcc41c2d781a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.065037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd81ce-1804-4b03-aa1e-bcc41c2d781a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.088000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a6cd81ce-1804-4b03-aa1e-bcc41c2d781a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:14.089590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a6cd81ce-1804-4b03-aa1e-bcc41c2d781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:14.108704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1012/2035] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:14.110779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd81ce-1804-4b03-aa1e-bcc41c2d781a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.133768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd81ce-1804-4b03-aa1e-bcc41c2d781a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:14.143403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71a0a5-2b21-4073-b75e-1a384e44fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.144579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71a0a5-2b21-4073-b75e-1a384e44fcbb admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.144959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71a0a5-2b21-4073-b75e-1a384e44fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.145436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71a0a5-2b21-4073-b75e-1a384e44fcbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.146914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71a0a5-2b21-4073-b75e-1a384e44fcbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:14.147335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71a0a5-2b21-4073-b75e-1a384e44fcbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.149153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71a0a5-2b21-4073-b75e-1a384e44fcbb admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.171655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1013/2036] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:19:14.177698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71a0a5-2b21-4073-b75e-1a384e44fcbb admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.192593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71a0a5-2b21-4073-b75e-1a384e44fcbb admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:14.228526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196cf7bb302d4a6cb3a235386b3446a8', 'request_id': 'req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:14.262261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1ba2e-4882-433b-b703-d199fbd4abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.262886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1ba2e-4882-433b-b703-d199fbd4abde admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.263168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1ba2e-4882-433b-b703-d199fbd4abde admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.263446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1ba2e-4882-433b-b703-d199fbd4abde admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.264116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1ba2e-4882-433b-b703-d199fbd4abde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.266056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1ba2e-4882-433b-b703-d199fbd4abde admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.322140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196cf7bb302d4a6cb3a235386b3446a8', 'request_id': 'req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:14.333777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196cf7bb302d4a6cb3a235386b3446a8', 'request_id': 'req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:14.347013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] The token cache is being invalidate because project 196cf7bb302d4a6cb3a235386b3446a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:14.347191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:14.348086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-00c0c8d7-8773-4edd-97c6-6ea88fe7f1d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:14.350977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1024/2037] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:13 2022] DELETE /identity/v3/projects/196cf7bb302d4a6cb3a235386b3446a8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:14.355644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8311b8-82cd-488a-8f1f-338217de7d9c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.356274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8311b8-82cd-488a-8f1f-338217de7d9c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.356716 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8311b8-82cd-488a-8f1f-338217de7d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.379441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5d8311b8-82cd-488a-8f1f-338217de7d9c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:14.380853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5d8311b8-82cd-488a-8f1f-338217de7d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:14.390519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1025/2038] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:14.399719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1014/2039] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:14 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:14.400597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bc65c-3ba6-4e80-835e-523b34b2d1ad None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.400986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bc65c-3ba6-4e80-835e-523b34b2d1ad None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.401364 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bc65c-3ba6-4e80-835e-523b34b2d1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.403778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1ba2e-4882-433b-b703-d199fbd4abde admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.405544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-48e1ba2e-4882-433b-b703-d199fbd4abde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:14.427852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-348bc65c-3ba6-4e80-835e-523b34b2d1ad None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:14.427852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-348bc65c-3ba6-4e80-835e-523b34b2d1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:14.512737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1ba2e-4882-433b-b703-d199fbd4abde admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:14.531052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c5018-3288-422f-80b3-ce4294f5ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.531052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c5018-3288-422f-80b3-ce4294f5ea9b admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.531052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c5018-3288-422f-80b3-ce4294f5ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.531052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c5018-3288-422f-80b3-ce4294f5ea9b admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.532136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c5018-3288-422f-80b3-ce4294f5ea9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.532136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c5018-3288-422f-80b3-ce4294f5ea9b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.532293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1026/2040] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:14.532293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bc65c-3ba6-4e80-835e-523b34b2d1ad None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.539010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bc65c-3ba6-4e80-835e-523b34b2d1ad None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:14.543788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb5c8c-c241-45bd-ab89-d572fbc454f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.544501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5c8c-c241-45bd-ab89-d572fbc454f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.544787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5c8c-c241-45bd-ab89-d572fbc454f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.545058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5c8c-c241-45bd-ab89-d572fbc454f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.545742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb5c8c-c241-45bd-ab89-d572fbc454f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:14.546046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb5c8c-c241-45bd-ab89-d572fbc454f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.547735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb5c8c-c241-45bd-ab89-d572fbc454f6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.560610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1027/2041] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:19:14.565220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb5c8c-c241-45bd-ab89-d572fbc454f6 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.575819 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb5c8c-c241-45bd-ab89-d572fbc454f6 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:14.580739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a6ad7-491d-4001-9e96-b75a9758458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.581945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6ad7-491d-4001-9e96-b75a9758458b admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.582233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6ad7-491d-4001-9e96-b75a9758458b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.582509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6ad7-491d-4001-9e96-b75a9758458b admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.583890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a6ad7-491d-4001-9e96-b75a9758458b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.585633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a6ad7-491d-4001-9e96-b75a9758458b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.631006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1015/2042] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:14 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:14.634789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c5018-3288-422f-80b3-ce4294f5ea9b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.644974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c5018-3288-422f-80b3-ce4294f5ea9b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:14.650305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3367-aead-436f-a450-ee44396739b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.650919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3367-aead-436f-a450-ee44396739b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.651204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3367-aead-436f-a450-ee44396739b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.651477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3367-aead-436f-a450-ee44396739b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.652156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb3367-aead-436f-a450-ee44396739b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.653766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb3367-aead-436f-a450-ee44396739b7 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.664068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1016/2043] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:14.668157 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3367-aead-436f-a450-ee44396739b7 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.678184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3367-aead-436f-a450-ee44396739b7 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:14.682934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdcf04-d1ce-4046-abc2-370679709c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.683525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdcf04-d1ce-4046-abc2-370679709c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.683898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdcf04-d1ce-4046-abc2-370679709c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.684166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdcf04-d1ce-4046-abc2-370679709c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.684828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdcf04-d1ce-4046-abc2-370679709c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.686411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdcf04-d1ce-4046-abc2-370679709c9b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.697487 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1017/2044] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:19:14.701685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdcf04-d1ce-4046-abc2-370679709c9b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.712189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdcf04-d1ce-4046-abc2-370679709c9b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:14.717557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9a450-ae62-4267-a8f8-31f319ec9b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.718222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9a450-ae62-4267-a8f8-31f319ec9b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.718552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9a450-ae62-4267-a8f8-31f319ec9b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.718832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9a450-ae62-4267-a8f8-31f319ec9b86 admin admin] PATH_INFO: `/v3/projects/bdc87e2f20a54f28b0f0d391aa01c2ce/users/21e4523e2d324c168e23ea16181b5fe1/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.737661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9a450-ae62-4267-a8f8-31f319ec9b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc87e2f20a54f28b0f0d391aa01c2ce, user_id=21e4523e2d324c168e23ea16181b5fe1, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.738355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1028/2045] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:14 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:14.741557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9a450-ae62-4267-a8f8-31f319ec9b86 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.743448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a6ad7-491d-4001-9e96-b75a9758458b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.825808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a6ad7-491d-4001-9e96-b75a9758458b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:14.830482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c157757-1a98-4b1c-a2b4-928dd4c795d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:14.831353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c157757-1a98-4b1c-a2b4-928dd4c795d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.831638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c157757-1a98-4b1c-a2b4-928dd4c795d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.831914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c157757-1a98-4b1c-a2b4-928dd4c795d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.832564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c157757-1a98-4b1c-a2b4-928dd4c795d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:14.835028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c157757-1a98-4b1c-a2b4-928dd4c795d6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:14.869623 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1018/2046] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:14 2022] PUT /identity/v3/projects/bdc87e2f20a54f28b0f0d391aa01c2ce/users/21e4523e2d324c168e23ea16181b5fe1/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:19:14.883352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050b625-109f-4936-ad07-13e0ecdfa7d9 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:14.883677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050b625-109f-4936-ad07-13e0ecdfa7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:14.884006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050b625-109f-4936-ad07-13e0ecdfa7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:14.914689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-4050b625-109f-4936-ad07-13e0ecdfa7d9 None None] MFA Rules not processed for user `21e4523e2d324c168e23ea16181b5fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:14.916096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4050b625-109f-4936-ad07-13e0ecdfa7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:14.939078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1029/2047] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:14 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:14.944199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c157757-1a98-4b1c-a2b4-928dd4c795d6 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:14.955723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c157757-1a98-4b1c-a2b4-928dd4c795d6 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:15.001341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1019/2048] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:15.013801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050b625-109f-4936-ad07-13e0ecdfa7d9 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:15.015229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4050b625-109f-4936-ad07-13e0ecdfa7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:15.060302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd97ff4-9524-4340-9dcc-2a0d58ffbe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:15.065994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd97ff4-9524-4340-9dcc-2a0d58ffbe9e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:15.069380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd97ff4-9524-4340-9dcc-2a0d58ffbe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:15.069931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd97ff4-9524-4340-9dcc-2a0d58ffbe9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:15.071220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd97ff4-9524-4340-9dcc-2a0d58ffbe9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:15.074476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd97ff4-9524-4340-9dcc-2a0d58ffbe9e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:15.090018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050b625-109f-4936-ad07-13e0ecdfa7d9 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:15.093960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e883-ed37-4b20-87e0-ba3d09e3fc51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:15.094602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e883-ed37-4b20-87e0-ba3d09e3fc51 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:15.094867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1030/2049] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:15.095091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e883-ed37-4b20-87e0-ba3d09e3fc51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:15.095377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8e883-ed37-4b20-87e0-ba3d09e3fc51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:15.100508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd97ff4-9524-4340-9dcc-2a0d58ffbe9e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:15.106891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8e883-ed37-4b20-87e0-ba3d09e3fc51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:15.108364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8e883-ed37-4b20-87e0-ba3d09e3fc51 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:15.119799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1020/2050] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:19:15.122302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd97ff4-9524-4340-9dcc-2a0d58ffbe9e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:15.129362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ad734-5bb9-4cda-bb19-1c72c583947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:15.131034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ad734-5bb9-4cda-bb19-1c72c583947b admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:15.131502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ad734-5bb9-4cda-bb19-1c72c583947b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:15.131995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ad734-5bb9-4cda-bb19-1c72c583947b admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:15.133532 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ad734-5bb9-4cda-bb19-1c72c583947b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:15.137071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ad734-5bb9-4cda-bb19-1c72c583947b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:15.137813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:15.158576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e883-ed37-4b20-87e0-ba3d09e3fc51 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:15.165194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1031/2051] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:15.166333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ad734-5bb9-4cda-bb19-1c72c583947b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:15.174911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8e883-ed37-4b20-87e0-ba3d09e3fc51 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:15.190947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:15.191868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:15.193101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:15.193560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] PATH_INFO: `/v3/users/21e4523e2d324c168e23ea16181b5fe1` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:15.195005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e4523e2d324c168e23ea16181b5fe1)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:15.197195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:15.204461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ad734-5bb9-4cda-bb19-1c72c583947b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:15.234859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d6703-7bd7-412e-bb8f-38884ca2caba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:15.234859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6703-7bd7-412e-bb8f-38884ca2caba admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:15.234859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6703-7bd7-412e-bb8f-38884ca2caba admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:15.234859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6703-7bd7-412e-bb8f-38884ca2caba admin admin] PATH_INFO: `/v3/projects/b3e2cad3a76648ca878cc4c90ce3fc8b/users/0660de8e84894260b053754e90725562/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:15.258175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:15.269767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d6703-7bd7-412e-bb8f-38884ca2caba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e2cad3a76648ca878cc4c90ce3fc8b, user_id=0660de8e84894260b053754e90725562, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:15.273040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d6703-7bd7-412e-bb8f-38884ca2caba admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:15.375316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1032/2052] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:15 2022] PUT /identity/v3/projects/b3e2cad3a76648ca878cc4c90ce3fc8b/users/0660de8e84894260b053754e90725562/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:15.380679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444b89-573f-4420-9aed-e8e918ce5fdc None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:15.380963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444b89-573f-4420-9aed-e8e918ce5fdc None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:15.381422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444b89-573f-4420-9aed-e8e918ce5fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:15.442020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-bf444b89-573f-4420-9aed-e8e918ce5fdc None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:15.443079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e4523e2d324c168e23ea16181b5fe1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:15.444965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bf444b89-573f-4420-9aed-e8e918ce5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:15.520962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e4523e2d324c168e23ea16181b5fe1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:15.532476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1033/2053] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:15.545594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444b89-573f-4420-9aed-e8e918ce5fdc None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:15.550671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e4523e2d324c168e23ea16181b5fe1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:15.550822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bf444b89-573f-4420-9aed-e8e918ce5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:15.553837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e4523e2d324c168e23ea16181b5fe1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:15.570102 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bdf11a22-ba05-47d2-9cab-418958669db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e4523e2d324c168e23ea16181b5fe1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:15.585859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1021/2054] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:15 2022] DELETE /identity/v3/users/21e4523e2d324c168e23ea16181b5fe1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:19:15.591703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac50e2-a148-44a7-80e3-b0c1d1253702 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:15.591998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac50e2-a148-44a7-80e3-b0c1d1253702 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:15.592325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac50e2-a148-44a7-80e3-b0c1d1253702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:15.624320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f0ac50e2-a148-44a7-80e3-b0c1d1253702 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:15.625924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f0ac50e2-a148-44a7-80e3-b0c1d1253702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:15.687391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444b89-573f-4420-9aed-e8e918ce5fdc None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:15.740915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1022/2055] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:15.751515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac50e2-a148-44a7-80e3-b0c1d1253702 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:15.753752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f0ac50e2-a148-44a7-80e3-b0c1d1253702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:15.769900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:15.771174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:15.776260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:15.776260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:15.779489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:15.803099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:15.805016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:15.836145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1034/2056] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:15.851316 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac50e2-a148-44a7-80e3-b0c1d1253702 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:15.856929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e19d6-b93a-478a-bb01-ae5d6a109fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:15.857624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e19d6-b93a-478a-bb01-ae5d6a109fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:15.857945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e19d6-b93a-478a-bb01-ae5d6a109fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:15.858221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e19d6-b93a-478a-bb01-ae5d6a109fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:15.870672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e19d6-b93a-478a-bb01-ae5d6a109fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:15.872180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e19d6-b93a-478a-bb01-ae5d6a109fb3 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:15.883859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1023/2057] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:19:16.223747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:16.584268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:16.584268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:16.592084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12bef-1ee2-46d0-b078-d7fb52b94ef7 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:16.597802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:16.617728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:16.617728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:16.617728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] PATH_INFO: `/v3/projects/bdc87e2f20a54f28b0f0d391aa01c2ce` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:16.618379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc87e2f20a54f28b0f0d391aa01c2ce)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:16.628659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:16.770747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc87e2f20a54f28b0f0d391aa01c2ce', 'request_id': 'req-13704a0d-bd4f-4d96-ba3a-31d790b473d4'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:16.847973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc87e2f20a54f28b0f0d391aa01c2ce', 'request_id': 'req-13704a0d-bd4f-4d96-ba3a-31d790b473d4'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:16.861640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a42bb-79d1-4d01-8897-52fdf3c575e4 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:16.863285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc87e2f20a54f28b0f0d391aa01c2ce', 'request_id': 'req-13704a0d-bd4f-4d96-ba3a-31d790b473d4'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:16.863504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a42bb-79d1-4d01-8897-52fdf3c575e4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:16.864009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a42bb-79d1-4d01-8897-52fdf3c575e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:16.876912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] The token cache is being invalidate because project bdc87e2f20a54f28b0f0d391aa01c2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:16.877202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:16.878071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-13704a0d-bd4f-4d96-ba3a-31d790b473d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:16.879892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1035/2058] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:16 2022] DELETE /identity/v3/projects/bdc87e2f20a54f28b0f0d391aa01c2ce => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:16.885374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bb974-b298-493d-8714-97bcd0b66249 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:16.887115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bb974-b298-493d-8714-97bcd0b66249 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:16.887587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bb974-b298-493d-8714-97bcd0b66249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:16.897662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b44a42bb-79d1-4d01-8897-52fdf3c575e4 None None] MFA Rules not processed for user `22369962f4954442ab2b873499889d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:16.900311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b44a42bb-79d1-4d01-8897-52fdf3c575e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:16.913679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-860bb974-b298-493d-8714-97bcd0b66249 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:16.915075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-860bb974-b298-493d-8714-97bcd0b66249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:16.985453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1024/2059] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:17.039292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1036/2060] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:17.046640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91453-e2da-4929-a08e-29326b32cbc5 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:17.046928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91453-e2da-4929-a08e-29326b32cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:17.048020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91453-e2da-4929-a08e-29326b32cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:17.080689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-1da91453-e2da-4929-a08e-29326b32cbc5 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:17.080689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-1da91453-e2da-4929-a08e-29326b32cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:17.093410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1025/2061] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:17.094277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bb974-b298-493d-8714-97bcd0b66249 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:17.110783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bb974-b298-493d-8714-97bcd0b66249 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:17.117428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b32a2-dd02-421d-860c-7cf23150639e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:17.120293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b32a2-dd02-421d-860c-7cf23150639e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:17.121726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b32a2-dd02-421d-860c-7cf23150639e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:17.122125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b32a2-dd02-421d-860c-7cf23150639e admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:17.122921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b32a2-dd02-421d-860c-7cf23150639e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:17.123329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b32a2-dd02-421d-860c-7cf23150639e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:17.126121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b32a2-dd02-421d-860c-7cf23150639e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:17.150170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1037/2062] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:19:17.154506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91453-e2da-4929-a08e-29326b32cbc5 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:17.164645 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91453-e2da-4929-a08e-29326b32cbc5 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:17.170011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3a5cf-5ba7-4371-891b-c1bcbcccb8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:17.170917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3a5cf-5ba7-4371-891b-c1bcbcccb8ca admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:17.171410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3a5cf-5ba7-4371-891b-c1bcbcccb8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:17.172002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3a5cf-5ba7-4371-891b-c1bcbcccb8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:17.172852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3a5cf-5ba7-4371-891b-c1bcbcccb8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:17.175003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3a5cf-5ba7-4371-891b-c1bcbcccb8ca admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:17.311486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1026/2063] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:17 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:17.318495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:17.320390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b32a2-dd02-421d-860c-7cf23150639e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:17.334912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b32a2-dd02-421d-860c-7cf23150639e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:17.462866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093b2ef-9ea0-49c7-8efd-503448a90429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:17.472663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093b2ef-9ea0-49c7-8efd-503448a90429 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:17.474237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093b2ef-9ea0-49c7-8efd-503448a90429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:17.474237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093b2ef-9ea0-49c7-8efd-503448a90429 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:17.474441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093b2ef-9ea0-49c7-8efd-503448a90429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:17.476427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093b2ef-9ea0-49c7-8efd-503448a90429 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:17.578313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c524887-5d04-481b-9ecf-09266ccb859d None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:17.578628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c524887-5d04-481b-9ecf-09266ccb859d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:17.578893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c524887-5d04-481b-9ecf-09266ccb859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:17.592078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1038/2064] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:17 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:17.596149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093b2ef-9ea0-49c7-8efd-503448a90429 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:17.613151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093b2ef-9ea0-49c7-8efd-503448a90429 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:17.632599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201cc4e-2e47-41e2-a6ba-fd42e293dd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:17.633237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201cc4e-2e47-41e2-a6ba-fd42e293dd14 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:17.633523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201cc4e-2e47-41e2-a6ba-fd42e293dd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:17.633822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201cc4e-2e47-41e2-a6ba-fd42e293dd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:17.634472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201cc4e-2e47-41e2-a6ba-fd42e293dd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:17.636312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201cc4e-2e47-41e2-a6ba-fd42e293dd14 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:17.637586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-0c524887-5d04-481b-9ecf-09266ccb859d None None] MFA Rules not processed for user `0660de8e84894260b053754e90725562`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:17.638823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0c524887-5d04-481b-9ecf-09266ccb859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:17.657873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1039/2065] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:19:17.661670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201cc4e-2e47-41e2-a6ba-fd42e293dd14 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:17.672334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201cc4e-2e47-41e2-a6ba-fd42e293dd14 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:17.681152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf30bed-99ed-42b3-a035-3829b1db38a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:17.681786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30bed-99ed-42b3-a035-3829b1db38a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:17.682072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30bed-99ed-42b3-a035-3829b1db38a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:17.682351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30bed-99ed-42b3-a035-3829b1db38a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:17.683004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf30bed-99ed-42b3-a035-3829b1db38a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:17.685152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf30bed-99ed-42b3-a035-3829b1db38a2 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:17.702814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1040/2066] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:19:17.704349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf30bed-99ed-42b3-a035-3829b1db38a2 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:17.727352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf30bed-99ed-42b3-a035-3829b1db38a2 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:17.740900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd591e0-38e4-4db4-9e54-02ee70f3bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:17.741963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd591e0-38e4-4db4-9e54-02ee70f3bf28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:17.742375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd591e0-38e4-4db4-9e54-02ee70f3bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:17.742857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd591e0-38e4-4db4-9e54-02ee70f3bf28 admin admin] PATH_INFO: `/v3/projects/48e3b556fb704bb9b57cf91237bd8c43/users/eee5f42472924801afbd4fcacd9da2b5/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:17.769821 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd591e0-38e4-4db4-9e54-02ee70f3bf28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e3b556fb704bb9b57cf91237bd8c43, user_id=eee5f42472924801afbd4fcacd9da2b5, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:17.778036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd591e0-38e4-4db4-9e54-02ee70f3bf28 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:17.798111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1027/2067] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:17.810190 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c524887-5d04-481b-9ecf-09266ccb859d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:17.812084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0c524887-5d04-481b-9ecf-09266ccb859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:17.877182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1041/2068] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:17 2022] PUT /identity/v3/projects/48e3b556fb704bb9b57cf91237bd8c43/users/eee5f42472924801afbd4fcacd9da2b5/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:17.895439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b9c2a-7f34-48d4-9f20-7fa4095cf020 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:17.895841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b9c2a-7f34-48d4-9f20-7fa4095cf020 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:17.896276 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b9c2a-7f34-48d4-9f20-7fa4095cf020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:17.907164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c524887-5d04-481b-9ecf-09266ccb859d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:17.953986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-fb0b9c2a-7f34-48d4-9f20-7fa4095cf020 None None] MFA Rules not processed for user `eee5f42472924801afbd4fcacd9da2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:17.955981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fb0b9c2a-7f34-48d4-9f20-7fa4095cf020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:18.015551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d84ea-097a-4e42-b2de-e96d6113cd00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:18.016684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d84ea-097a-4e42-b2de-e96d6113cd00 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:18.017178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d84ea-097a-4e42-b2de-e96d6113cd00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:18.017655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d84ea-097a-4e42-b2de-e96d6113cd00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:18.131854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d84ea-097a-4e42-b2de-e96d6113cd00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:18.133519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d84ea-097a-4e42-b2de-e96d6113cd00 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:18.143690 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1042/2069] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:18.147351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1028/2070] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:19:18.164095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b9c2a-7f34-48d4-9f20-7fa4095cf020 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:18.165616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fb0b9c2a-7f34-48d4-9f20-7fa4095cf020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:18.179248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b9c2a-7f34-48d4-9f20-7fa4095cf020 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:18.183906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034487-873b-4226-b18e-7f219696dfd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:18.184528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034487-873b-4226-b18e-7f219696dfd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:18.184803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034487-873b-4226-b18e-7f219696dfd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:18.185074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034487-873b-4226-b18e-7f219696dfd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:18.195200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034487-873b-4226-b18e-7f219696dfd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:18.196847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034487-873b-4226-b18e-7f219696dfd0 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:18.208504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1043/2071] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:18.535983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:19.623362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:20.280532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6439b-6d8f-4a45-bdc0-a854c2973c6f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:20.280939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6439b-6d8f-4a45-bdc0-a854c2973c6f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:20.281315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6439b-6d8f-4a45-bdc0-a854c2973c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:20.307715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a4f6439b-6d8f-4a45-bdc0-a854c2973c6f None None] MFA Rules not processed for user `0660de8e84894260b053754e90725562`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:20.308948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a4f6439b-6d8f-4a45-bdc0-a854c2973c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:20.316634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1029/2072] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:21.012425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:22.480269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:24.051107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:25.653090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:25.898234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:27.589524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:27.817917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:31.958846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034487-873b-4226-b18e-7f219696dfd0 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:32.041380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034487-873b-4226-b18e-7f219696dfd0 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:32.046706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:32.047464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:32.047856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:32.048315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] PATH_INFO: `/v3/users/eee5f42472924801afbd4fcacd9da2b5` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:32.049670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee5f42472924801afbd4fcacd9da2b5)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:32.052340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:32.291498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee5f42472924801afbd4fcacd9da2b5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.292709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee5f42472924801afbd4fcacd9da2b5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.320613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6439b-6d8f-4a45-bdc0-a854c2973c6f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:32.323859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a4f6439b-6d8f-4a45-bdc0-a854c2973c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:32.340831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6439b-6d8f-4a45-bdc0-a854c2973c6f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:32.349407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:32.350474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:32.350981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:32.351505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] PATH_INFO: `/v3/users/832577e80cfc4767902edd71f83e711f` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:32.353160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832577e80cfc4767902edd71f83e711f)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:32.355887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:32.400530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee5f42472924801afbd4fcacd9da2b5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.401382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee5f42472924801afbd4fcacd9da2b5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.416630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a1d2df6-d972-46d2-ae32-3cc30a775a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee5f42472924801afbd4fcacd9da2b5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.466188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1044/2073] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:31 2022] DELETE /identity/v3/users/eee5f42472924801afbd4fcacd9da2b5 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:32.472758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3112-be00-45a5-b48d-e66ce6516b98 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:32.472758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3112-be00-45a5-b48d-e66ce6516b98 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:32.472758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3112-be00-45a5-b48d-e66ce6516b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:32.509219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3b8f3112-be00-45a5-b48d-e66ce6516b98 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:32.511486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3b8f3112-be00-45a5-b48d-e66ce6516b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:32.568530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:32.613264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1045/2074] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:32.614117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3112-be00-45a5-b48d-e66ce6516b98 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:32.617096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3b8f3112-be00-45a5-b48d-e66ce6516b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:32.626352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832577e80cfc4767902edd71f83e711f'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.701152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3112-be00-45a5-b48d-e66ce6516b98 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:32.705243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc638cdb-03fa-46c6-a8da-8092ea1cfd6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:32.705868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc638cdb-03fa-46c6-a8da-8092ea1cfd6d service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:32.706486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc638cdb-03fa-46c6-a8da-8092ea1cfd6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:32.706794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc638cdb-03fa-46c6-a8da-8092ea1cfd6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:32.709435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832577e80cfc4767902edd71f83e711f'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.721949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc638cdb-03fa-46c6-a8da-8092ea1cfd6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:32.723478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc638cdb-03fa-46c6-a8da-8092ea1cfd6d service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:32.739103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832577e80cfc4767902edd71f83e711f'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.744466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832577e80cfc4767902edd71f83e711f'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.746769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1046/2075] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:32.773661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832577e80cfc4767902edd71f83e711f'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:32.787489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1030/2076] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:32 2022] DELETE /identity/v3/users/832577e80cfc4767902edd71f83e711f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:32.792063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff3ae-9bf4-43d5-a345-fde1a8412d47 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:32.792416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff3ae-9bf4-43d5-a345-fde1a8412d47 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:32.792753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ff3ae-9bf4-43d5-a345-fde1a8412d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:32.820201 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-c44ff3ae-9bf4-43d5-a345-fde1a8412d47 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:32.821749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c44ff3ae-9bf4-43d5-a345-fde1a8412d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:32.906409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1047/2077] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:32.916734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:32.919176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:32.981315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d698ca-6867-4e78-a1fd-9c6d3704ce37 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:32.985083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a89b-cded-4b45-a6d4-1e7e89cf6d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:32.985737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a89b-cded-4b45-a6d4-1e7e89cf6d71 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:32.986024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a89b-cded-4b45-a6d4-1e7e89cf6d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:32.986320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a89b-cded-4b45-a6d4-1e7e89cf6d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:32.997808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a89b-cded-4b45-a6d4-1e7e89cf6d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:32.999329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a89b-cded-4b45-a6d4-1e7e89cf6d71 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:33.009040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1031/2078] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:33.290074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ff3ae-9bf4-43d5-a345-fde1a8412d47 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:33.290775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c44ff3ae-9bf4-43d5-a345-fde1a8412d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:33.302717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ff3ae-9bf4-43d5-a345-fde1a8412d47 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:33.307596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:33.308271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:33.309196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:33.309196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] PATH_INFO: `/v3/projects/48e3b556fb704bb9b57cf91237bd8c43` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:33.310098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e3b556fb704bb9b57cf91237bd8c43)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:33.312358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:33.471359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e3b556fb704bb9b57cf91237bd8c43', 'request_id': 'req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.481836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a89b-cded-4b45-a6d4-1e7e89cf6d71 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:33.483226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-17c1a89b-cded-4b45-a6d4-1e7e89cf6d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:33.499356 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a89b-cded-4b45-a6d4-1e7e89cf6d71 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:33.543237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e3b556fb704bb9b57cf91237bd8c43', 'request_id': 'req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.543971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:33.550787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e3b556fb704bb9b57cf91237bd8c43', 'request_id': 'req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.563592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] The token cache is being invalidate because project 48e3b556fb704bb9b57cf91237bd8c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:33.564000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.564689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.566410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1048/2079] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:33 2022] DELETE /identity/v3/projects/48e3b556fb704bb9b57cf91237bd8c43 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:33.583757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:33.589276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:33.589276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:33.589276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] PATH_INFO: `/v3/projects/056968710b5b4e7681ac755d0fc9f1d6` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:33.589276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=056968710b5b4e7681ac755d0fc9f1d6)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:33.589276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:33.774973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056968710b5b4e7681ac755d0fc9f1d6', 'request_id': 'req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.782513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056968710b5b4e7681ac755d0fc9f1d6', 'request_id': 'req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.909254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056968710b5b4e7681ac755d0fc9f1d6', 'request_id': 'req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.922299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] The token cache is being invalidate because project 056968710b5b4e7681ac755d0fc9f1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:33.922702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.923420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:33.930312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:33.931144 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1032/2080] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:33 2022] DELETE /identity/v3/projects/056968710b5b4e7681ac755d0fc9f1d6 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:33.931865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:33.947261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eba74-d2c4-4fcb-aa56-4a7667efd67f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:33.958499 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:34.013569 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:34.014224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:34.014508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:34.015041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] PATH_INFO: `/v3/users/6926fc444e244bf99b2437857882bc0d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:34.016367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6926fc444e244bf99b2437857882bc0d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:34.018276 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:34.243263 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6926fc444e244bf99b2437857882bc0d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:34.244161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6926fc444e244bf99b2437857882bc0d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:34.337768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6926fc444e244bf99b2437857882bc0d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:34.338446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6926fc444e244bf99b2437857882bc0d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:34.346200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-49658489-8525-473b-9517-17f7bcea1a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6926fc444e244bf99b2437857882bc0d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:34.366388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1049/2081] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:33 2022] DELETE /identity/v3/users/6926fc444e244bf99b2437857882bc0d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:19:34.956565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:34.958127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:34.977417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755af3dd-31e8-4a09-8f0a-2ff576c83d2a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:35.055205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:35.056269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:35.056740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:35.057164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] PATH_INFO: `/v3/projects/3c3b41f719a64860bf162d90ff81ddcf` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:35.058686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c3b41f719a64860bf162d90ff81ddcf)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:35.060928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:35.193056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c3b41f719a64860bf162d90ff81ddcf', 'request_id': 'req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:35.199526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c3b41f719a64860bf162d90ff81ddcf', 'request_id': 'req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:35.280034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c3b41f719a64860bf162d90ff81ddcf', 'request_id': 'req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:35.284972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:35.294091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] The token cache is being invalidate because project 3c3b41f719a64860bf162d90ff81ddcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:35.294383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:35.295047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-ba810bb8-b08b-42f6-a08c-4ff0423e9bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:35.299135 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1033/2082] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:34 2022] DELETE /identity/v3/projects/3c3b41f719a64860bf162d90ff81ddcf => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:35.301803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a1ac9-825d-42ac-8868-12f98a434c27 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:35.302361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a1ac9-825d-42ac-8868-12f98a434c27 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:35.302754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a1ac9-825d-42ac-8868-12f98a434c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:35.324371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-c53a1ac9-825d-42ac-8868-12f98a434c27 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:35.325600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c53a1ac9-825d-42ac-8868-12f98a434c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:35.397170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1050/2083] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:35.407511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999d12c-bf77-452a-aa75-be702b280eb9 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:35.407833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999d12c-bf77-452a-aa75-be702b280eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:35.408119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999d12c-bf77-452a-aa75-be702b280eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:35.438447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-3999d12c-bf77-452a-aa75-be702b280eb9 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:35.438447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3999d12c-bf77-452a-aa75-be702b280eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:35.456790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1034/2084] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:35.462941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a1ac9-825d-42ac-8868-12f98a434c27 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:35.477064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a1ac9-825d-42ac-8868-12f98a434c27 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:35.482472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2c205-f4a8-4510-8b79-e24ed61ae518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:35.483252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c205-f4a8-4510-8b79-e24ed61ae518 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:35.483656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c205-f4a8-4510-8b79-e24ed61ae518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:35.484829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c205-f4a8-4510-8b79-e24ed61ae518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:35.485008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2c205-f4a8-4510-8b79-e24ed61ae518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:35.485441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2c205-f4a8-4510-8b79-e24ed61ae518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:35.487129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2c205-f4a8-4510-8b79-e24ed61ae518 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:35.502069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1051/2085] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:19:35.508726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999d12c-bf77-452a-aa75-be702b280eb9 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:35.520743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999d12c-bf77-452a-aa75-be702b280eb9 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:35.526084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564a928-d37e-47b3-8752-f693be6b1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:35.526983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a928-d37e-47b3-8752-f693be6b1313 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:35.527080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a928-d37e-47b3-8752-f693be6b1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:35.527347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a928-d37e-47b3-8752-f693be6b1313 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:35.528022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564a928-d37e-47b3-8752-f693be6b1313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:35.529959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564a928-d37e-47b3-8752-f693be6b1313 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:35.691556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1035/2086] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:35 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:35.693769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2c205-f4a8-4510-8b79-e24ed61ae518 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:35.709095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2c205-f4a8-4510-8b79-e24ed61ae518 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:35.726272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:35.773889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd9f1f-17dc-406c-b44a-a7e37966219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:35.774501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd9f1f-17dc-406c-b44a-a7e37966219f admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:35.774781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd9f1f-17dc-406c-b44a-a7e37966219f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:35.775051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd9f1f-17dc-406c-b44a-a7e37966219f admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:35.775746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd9f1f-17dc-406c-b44a-a7e37966219f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:35.777612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd9f1f-17dc-406c-b44a-a7e37966219f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:35.893755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1052/2087] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:35 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:35.898192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564a928-d37e-47b3-8752-f693be6b1313 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:35.909581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564a928-d37e-47b3-8752-f693be6b1313 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:35.918507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea0526-71ba-46cc-bf47-727e3609060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:35.919315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea0526-71ba-46cc-bf47-727e3609060c admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:35.919596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea0526-71ba-46cc-bf47-727e3609060c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:35.919902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea0526-71ba-46cc-bf47-727e3609060c admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:35.920558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea0526-71ba-46cc-bf47-727e3609060c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:35.922174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea0526-71ba-46cc-bf47-727e3609060c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:35.937247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1036/2088] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:35.945991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd9f1f-17dc-406c-b44a-a7e37966219f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:35.962264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd9f1f-17dc-406c-b44a-a7e37966219f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:35.968642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e460e8-cd73-4caf-b981-579f25010ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:35.977813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e460e8-cd73-4caf-b981-579f25010ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:35.977813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e460e8-cd73-4caf-b981-579f25010ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:35.977813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e460e8-cd73-4caf-b981-579f25010ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:35.977813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e460e8-cd73-4caf-b981-579f25010ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:35.977813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e460e8-cd73-4caf-b981-579f25010ea4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:35.990698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1053/2089] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:35.995808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea0526-71ba-46cc-bf47-727e3609060c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:36.014169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea0526-71ba-46cc-bf47-727e3609060c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:36.022274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dcfa1-2da1-4521-8a0b-75fdb0132de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:36.023424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcfa1-2da1-4521-8a0b-75fdb0132de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:36.023968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcfa1-2da1-4521-8a0b-75fdb0132de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:36.024469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcfa1-2da1-4521-8a0b-75fdb0132de2 admin admin] PATH_INFO: `/v3/projects/87cacbeab88d4ba3a0893b15f0e71b5f/users/b97c463c33434461a34ffa3618081ebd/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:36.053593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835dcfa1-2da1-4521-8a0b-75fdb0132de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cacbeab88d4ba3a0893b15f0e71b5f, user_id=b97c463c33434461a34ffa3618081ebd, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:36.059070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835dcfa1-2da1-4521-8a0b-75fdb0132de2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:36.197215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1037/2090] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:35 2022] PUT /identity/v3/projects/87cacbeab88d4ba3a0893b15f0e71b5f/users/b97c463c33434461a34ffa3618081ebd/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:19:36.199190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2e6fb-472d-4abb-a16b-2f1b2a628bef None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:36.199469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2e6fb-472d-4abb-a16b-2f1b2a628bef None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:36.199814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2e6fb-472d-4abb-a16b-2f1b2a628bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:36.252626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-08a2e6fb-472d-4abb-a16b-2f1b2a628bef None None] MFA Rules not processed for user `b97c463c33434461a34ffa3618081ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:36.254581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-08a2e6fb-472d-4abb-a16b-2f1b2a628bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:36.425391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1054/2091] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:36.431575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dcfa1-2da1-4521-8a0b-75fdb0132de2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:36.545629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dcfa1-2da1-4521-8a0b-75fdb0132de2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:36.551073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7657c-72ab-49ac-9900-7ff0db6045a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:36.552470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7657c-72ab-49ac-9900-7ff0db6045a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:36.552755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7657c-72ab-49ac-9900-7ff0db6045a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:36.553130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7657c-72ab-49ac-9900-7ff0db6045a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:36.553830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7657c-72ab-49ac-9900-7ff0db6045a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:36.556247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7657c-72ab-49ac-9900-7ff0db6045a9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:36.673729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1038/2092] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:36 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:36.678733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2e6fb-472d-4abb-a16b-2f1b2a628bef None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:36.693842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2e6fb-472d-4abb-a16b-2f1b2a628bef None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:36.760987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95909896-f31f-466a-a8cb-4cac610cfbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:36.760987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95909896-f31f-466a-a8cb-4cac610cfbba admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:36.762251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95909896-f31f-466a-a8cb-4cac610cfbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:36.762251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95909896-f31f-466a-a8cb-4cac610cfbba admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:36.762251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95909896-f31f-466a-a8cb-4cac610cfbba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:36.765720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95909896-f31f-466a-a8cb-4cac610cfbba admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:36.897120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1055/2093] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:36 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:36.900958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7657c-72ab-49ac-9900-7ff0db6045a9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:36.913363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7657c-72ab-49ac-9900-7ff0db6045a9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:36.926835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad4539-d2b8-42da-93ca-1c12af1e0870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:36.927673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4539-d2b8-42da-93ca-1c12af1e0870 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:36.928035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4539-d2b8-42da-93ca-1c12af1e0870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:36.928431 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4539-d2b8-42da-93ca-1c12af1e0870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:36.929244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad4539-d2b8-42da-93ca-1c12af1e0870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:36.930935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad4539-d2b8-42da-93ca-1c12af1e0870 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:36.945518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1039/2094] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:19:36.947291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95909896-f31f-466a-a8cb-4cac610cfbba admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:36.958619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95909896-f31f-466a-a8cb-4cac610cfbba admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:36.963366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ef0d8-6e11-4584-bb3f-469d66f1daf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:36.964096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef0d8-6e11-4584-bb3f-469d66f1daf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:36.964384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef0d8-6e11-4584-bb3f-469d66f1daf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:36.964669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef0d8-6e11-4584-bb3f-469d66f1daf3 admin admin] PATH_INFO: `/v3/projects/0af98226bffc454d9c65ed1379302edf/users/2f15cbae44dc45b6ba10492db67b5534/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:36.979420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:36.984011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ef0d8-6e11-4584-bb3f-469d66f1daf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af98226bffc454d9c65ed1379302edf, user_id=2f15cbae44dc45b6ba10492db67b5534, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:36.990239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ef0d8-6e11-4584-bb3f-469d66f1daf3 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:37.069842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1056/2095] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:36 2022] PUT /identity/v3/projects/0af98226bffc454d9c65ed1379302edf/users/2f15cbae44dc45b6ba10492db67b5534/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:19:37.073992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad4539-d2b8-42da-93ca-1c12af1e0870 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:37.085483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad4539-d2b8-42da-93ca-1c12af1e0870 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:37.157268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47b709-46ed-48d3-8276-8e3858e40901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:37.157952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47b709-46ed-48d3-8276-8e3858e40901 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:37.158236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47b709-46ed-48d3-8276-8e3858e40901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:37.158515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47b709-46ed-48d3-8276-8e3858e40901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:37.159208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47b709-46ed-48d3-8276-8e3858e40901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:37.160824 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47b709-46ed-48d3-8276-8e3858e40901 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:37.166350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:37.172028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1040/2096] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:37.176274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ef0d8-6e11-4584-bb3f-469d66f1daf3 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:37.189042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ef0d8-6e11-4584-bb3f-469d66f1daf3 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:37.194414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb429-9b24-4c8a-a3f4-5711560bfbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:37.195079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb429-9b24-4c8a-a3f4-5711560bfbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:37.195363 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb429-9b24-4c8a-a3f4-5711560bfbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:37.195647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb429-9b24-4c8a-a3f4-5711560bfbc0 admin admin] PATH_INFO: `/v3/projects/0af98226bffc454d9c65ed1379302edf/users/2f15cbae44dc45b6ba10492db67b5534/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:37.197872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb429-9b24-4c8a-a3f4-5711560bfbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af98226bffc454d9c65ed1379302edf, user_id=2f15cbae44dc45b6ba10492db67b5534, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:37.200527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb429-9b24-4c8a-a3f4-5711560bfbc0 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:37.213253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1057/2097] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:37 2022] PUT /identity/v3/projects/0af98226bffc454d9c65ed1379302edf/users/2f15cbae44dc45b6ba10492db67b5534/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:37.224426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2486-f292-479c-b7ce-d4594c4d7750 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:37.224787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2486-f292-479c-b7ce-d4594c4d7750 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:37.225236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2486-f292-479c-b7ce-d4594c4d7750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:37.259688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-942b2486-f292-479c-b7ce-d4594c4d7750 None None] MFA Rules not processed for user `2f15cbae44dc45b6ba10492db67b5534`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:37.260981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-942b2486-f292-479c-b7ce-d4594c4d7750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:37.356359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1041/2098] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:37.369613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb429-9b24-4c8a-a3f4-5711560bfbc0 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:37.374682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b7cbb429-9b24-4c8a-a3f4-5711560bfbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:37.479376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb429-9b24-4c8a-a3f4-5711560bfbc0 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:37.483848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f148-d41c-461a-a8aa-c96950c9dd9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:37.484487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f148-d41c-461a-a8aa-c96950c9dd9c service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:37.484769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f148-d41c-461a-a8aa-c96950c9dd9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:37.485137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f148-d41c-461a-a8aa-c96950c9dd9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:37.496563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0f148-d41c-461a-a8aa-c96950c9dd9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:37.498033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0f148-d41c-461a-a8aa-c96950c9dd9c service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:37.513151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1058/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:37.558259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b2486-f292-479c-b7ce-d4594c4d7750 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:37.659795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b2486-f292-479c-b7ce-d4594c4d7750 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:37.664530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:37.665241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:37.665532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:37.666727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] PATH_INFO: `/v3/users/b97c463c33434461a34ffa3618081ebd` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:37.667585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97c463c33434461a34ffa3618081ebd)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:37.669675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:37.953767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97c463c33434461a34ffa3618081ebd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:38.056448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97c463c33434461a34ffa3618081ebd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:38.092291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97c463c33434461a34ffa3618081ebd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:38.094826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97c463c33434461a34ffa3618081ebd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:38.107131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97c463c33434461a34ffa3618081ebd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:38.128887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1042/2100] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:37 2022] DELETE /identity/v3/users/b97c463c33434461a34ffa3618081ebd => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:38.136606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29af993-94b9-490d-9e2c-11d2f413f8e2 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:38.136606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29af993-94b9-490d-9e2c-11d2f413f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:38.136606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29af993-94b9-490d-9e2c-11d2f413f8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:38.159798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b29af993-94b9-490d-9e2c-11d2f413f8e2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:38.161823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b29af993-94b9-490d-9e2c-11d2f413f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:38.245577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1059/2101] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:38.256416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:38.260204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:38.274929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:38.393843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf20b5-d5eb-4574-8b9c-a9dbf182b785 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:38.406020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4a80-4119-48b2-b6a3-845308834352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:38.406020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4a80-4119-48b2-b6a3-845308834352 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:38.406020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4a80-4119-48b2-b6a3-845308834352 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:38.406020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db4a80-4119-48b2-b6a3-845308834352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:38.421397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db4a80-4119-48b2-b6a3-845308834352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:38.423961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db4a80-4119-48b2-b6a3-845308834352 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:38.442686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1043/2102] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:39.002766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29af993-94b9-490d-9e2c-11d2f413f8e2 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:39.004333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b29af993-94b9-490d-9e2c-11d2f413f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:39.019611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29af993-94b9-490d-9e2c-11d2f413f8e2 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:39.027811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:39.028506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:39.028757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:39.029036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] PATH_INFO: `/v3/projects/87cacbeab88d4ba3a0893b15f0e71b5f` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:39.031057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cacbeab88d4ba3a0893b15f0e71b5f)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:39.033562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:39.170977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cacbeab88d4ba3a0893b15f0e71b5f', 'request_id': 'req-700925c4-5606-4b42-bc7c-43f5b270da21'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.262786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cacbeab88d4ba3a0893b15f0e71b5f', 'request_id': 'req-700925c4-5606-4b42-bc7c-43f5b270da21'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.270210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cacbeab88d4ba3a0893b15f0e71b5f', 'request_id': 'req-700925c4-5606-4b42-bc7c-43f5b270da21'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.281396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] The token cache is being invalidate because project 87cacbeab88d4ba3a0893b15f0e71b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:39.281682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.282347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.283870 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1060/2103] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:39 2022] DELETE /identity/v3/projects/87cacbeab88d4ba3a0893b15f0e71b5f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:39.288491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4a80-4119-48b2-b6a3-845308834352 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:39.298268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db4a80-4119-48b2-b6a3-845308834352 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:39.357380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:39.358232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:39.358520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:39.358795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] PATH_INFO: `/v3/users/2f15cbae44dc45b6ba10492db67b5534` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:39.360042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f15cbae44dc45b6ba10492db67b5534)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:39.361973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:39.590033 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f15cbae44dc45b6ba10492db67b5534'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.641216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f15cbae44dc45b6ba10492db67b5534'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.662281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f15cbae44dc45b6ba10492db67b5534'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.663211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f15cbae44dc45b6ba10492db67b5534'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.672368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-8a4cfa73-e7a8-4c48-b8bc-775522bf04bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f15cbae44dc45b6ba10492db67b5534'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:39.679167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1044/2104] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:39 2022] DELETE /identity/v3/users/2f15cbae44dc45b6ba10492db67b5534 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:40.178782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:40.180323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:40.192969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:40.195470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700925c4-5606-4b42-bc7c-43f5b270da21 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:40.257946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:40.258583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:40.258859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:40.265626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] PATH_INFO: `/v3/projects/0af98226bffc454d9c65ed1379302edf` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:40.265626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af98226bffc454d9c65ed1379302edf)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:40.265626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:40.396921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af98226bffc454d9c65ed1379302edf', 'request_id': 'req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:40.480404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af98226bffc454d9c65ed1379302edf', 'request_id': 'req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:40.488341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af98226bffc454d9c65ed1379302edf', 'request_id': 'req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:40.500428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] The token cache is being invalidate because project 0af98226bffc454d9c65ed1379302edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:40.503129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:40.503129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bb50704e-7d0c-4b1c-ab56-2e1da4106d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:40.503129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1061/2105] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:40 2022] DELETE /identity/v3/projects/0af98226bffc454d9c65ed1379302edf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:40.508812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982b10-9eff-4de7-b69b-c5113c844871 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:40.509231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982b10-9eff-4de7-b69b-c5113c844871 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:40.509584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982b10-9eff-4de7-b69b-c5113c844871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:40.532869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-9b982b10-9eff-4de7-b69b-c5113c844871 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:40.534305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9b982b10-9eff-4de7-b69b-c5113c844871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:40.560752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:40.602052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1045/2106] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:40.611277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd6542-7ca7-4cd1-9903-fdcbf4b5f362 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:40.611540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd6542-7ca7-4cd1-9903-fdcbf4b5f362 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:40.612170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd6542-7ca7-4cd1-9903-fdcbf4b5f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:40.633857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e9cd6542-7ca7-4cd1-9903-fdcbf4b5f362 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:40.635114 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e9cd6542-7ca7-4cd1-9903-fdcbf4b5f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:40.644352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1062/2107] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:40.648688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b982b10-9eff-4de7-b69b-c5113c844871 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:40.659385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b982b10-9eff-4de7-b69b-c5113c844871 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:40.664397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901d01-87b1-4c42-90f0-2bfb7af4f97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:40.665008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901d01-87b1-4c42-90f0-2bfb7af4f97b admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:40.665294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901d01-87b1-4c42-90f0-2bfb7af4f97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:40.665574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901d01-87b1-4c42-90f0-2bfb7af4f97b admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:40.666225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901d01-87b1-4c42-90f0-2bfb7af4f97b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:40.666534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901d01-87b1-4c42-90f0-2bfb7af4f97b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:40.668353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901d01-87b1-4c42-90f0-2bfb7af4f97b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:40.682293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1046/2108] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:19:40.686449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd6542-7ca7-4cd1-9903-fdcbf4b5f362 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:40.704878 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd6542-7ca7-4cd1-9903-fdcbf4b5f362 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:40.714594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bc468-549a-4524-9bc2-d817464b2a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:40.715233 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bc468-549a-4524-9bc2-d817464b2a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:40.716148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bc468-549a-4524-9bc2-d817464b2a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:40.716432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bc468-549a-4524-9bc2-d817464b2a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:40.717084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bc468-549a-4524-9bc2-d817464b2a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:40.719274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bc468-549a-4524-9bc2-d817464b2a8b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:40.827812 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1063/2109] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:40 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:40.829227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901d01-87b1-4c42-90f0-2bfb7af4f97b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:40.839667 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901d01-87b1-4c42-90f0-2bfb7af4f97b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:40.902437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79c66a-10e9-4aaa-8c6d-515c8c49ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:40.903046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79c66a-10e9-4aaa-8c6d-515c8c49ab51 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:40.903331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79c66a-10e9-4aaa-8c6d-515c8c49ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:40.903636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79c66a-10e9-4aaa-8c6d-515c8c49ab51 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:40.904296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79c66a-10e9-4aaa-8c6d-515c8c49ab51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:40.906577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79c66a-10e9-4aaa-8c6d-515c8c49ab51 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:40.993921 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1047/2110] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:40 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:40.998167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bc468-549a-4524-9bc2-d817464b2a8b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:41.008506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bc468-549a-4524-9bc2-d817464b2a8b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:41.013101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd767df0-5648-4a6c-89af-e5487ba586ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:41.013842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd767df0-5648-4a6c-89af-e5487ba586ba admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.014127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd767df0-5648-4a6c-89af-e5487ba586ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.014437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd767df0-5648-4a6c-89af-e5487ba586ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.015095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd767df0-5648-4a6c-89af-e5487ba586ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:41.016800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd767df0-5648-4a6c-89af-e5487ba586ba admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:41.027048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1064/2111] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:41.031235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79c66a-10e9-4aaa-8c6d-515c8c49ab51 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:41.041830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79c66a-10e9-4aaa-8c6d-515c8c49ab51 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:41.046557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa1a5e-04cd-4961-a584-9af6e180dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:41.047143 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa1a5e-04cd-4961-a584-9af6e180dd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.047424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa1a5e-04cd-4961-a584-9af6e180dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.047744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa1a5e-04cd-4961-a584-9af6e180dd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.048383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa1a5e-04cd-4961-a584-9af6e180dd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:41.049984 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa1a5e-04cd-4961-a584-9af6e180dd19 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:41.061286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1048/2112] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:41.065561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd767df0-5648-4a6c-89af-e5487ba586ba admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:41.075361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd767df0-5648-4a6c-89af-e5487ba586ba admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:41.079910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb080b2-99d1-4d82-bd29-54264ac62636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:41.080550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb080b2-99d1-4d82-bd29-54264ac62636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.080830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb080b2-99d1-4d82-bd29-54264ac62636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.081366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb080b2-99d1-4d82-bd29-54264ac62636 admin admin] PATH_INFO: `/v3/projects/cf714b05580d405a94bf6a87ac7b5456/users/28211b4ba1a74056aaf39f981a1529dc/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.097823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb080b2-99d1-4d82-bd29-54264ac62636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf714b05580d405a94bf6a87ac7b5456, user_id=28211b4ba1a74056aaf39f981a1529dc, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:41.101028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb080b2-99d1-4d82-bd29-54264ac62636 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:41.195200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1065/2113] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:41 2022] PUT /identity/v3/projects/cf714b05580d405a94bf6a87ac7b5456/users/28211b4ba1a74056aaf39f981a1529dc/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:41.205841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5569-261f-4763-9e77-0c240eb1168e None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.206534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5569-261f-4763-9e77-0c240eb1168e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.206840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5569-261f-4763-9e77-0c240eb1168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.237671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-4def5569-261f-4763-9e77-0c240eb1168e None None] MFA Rules not processed for user `28211b4ba1a74056aaf39f981a1529dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:41.239072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4def5569-261f-4763-9e77-0c240eb1168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:41.309067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1049/2114] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:41.313611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb080b2-99d1-4d82-bd29-54264ac62636 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:41.349184 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:41.377688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb080b2-99d1-4d82-bd29-54264ac62636 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:41.382469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb932f76-3c59-4e6f-b32d-3a16c627b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:41.383104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb932f76-3c59-4e6f-b32d-3a16c627b41e admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.383385 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb932f76-3c59-4e6f-b32d-3a16c627b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.383685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb932f76-3c59-4e6f-b32d-3a16c627b41e admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.384326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb932f76-3c59-4e6f-b32d-3a16c627b41e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:41.386280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb932f76-3c59-4e6f-b32d-3a16c627b41e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:41.466071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1066/2115] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:41.470490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def5569-261f-4763-9e77-0c240eb1168e None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:41.484239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def5569-261f-4763-9e77-0c240eb1168e None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:41.503252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:41.543048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3f7ce-8b6b-4c22-ac9f-458f47c3a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:41.543718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3f7ce-8b6b-4c22-ac9f-458f47c3a5af admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.543877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3f7ce-8b6b-4c22-ac9f-458f47c3a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.544195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3f7ce-8b6b-4c22-ac9f-458f47c3a5af admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.544833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3f7ce-8b6b-4c22-ac9f-458f47c3a5af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:41.546763 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3f7ce-8b6b-4c22-ac9f-458f47c3a5af admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:41.626599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1050/2116] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:41 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:41.633269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb932f76-3c59-4e6f-b32d-3a16c627b41e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:41.643453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb932f76-3c59-4e6f-b32d-3a16c627b41e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:41.648724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d963a0-7c91-487d-846d-2fdc684357d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:41.649322 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d963a0-7c91-487d-846d-2fdc684357d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.649602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d963a0-7c91-487d-846d-2fdc684357d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.649874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d963a0-7c91-487d-846d-2fdc684357d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.650514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d963a0-7c91-487d-846d-2fdc684357d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:41.652133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d963a0-7c91-487d-846d-2fdc684357d4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:41.662103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1067/2117] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:41.666524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3f7ce-8b6b-4c22-ac9f-458f47c3a5af admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:41.676923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3f7ce-8b6b-4c22-ac9f-458f47c3a5af admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:41.681898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b292cea-d16f-45c3-a5e6-9de0d6ba72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:41.682558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b292cea-d16f-45c3-a5e6-9de0d6ba72db admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.682957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b292cea-d16f-45c3-a5e6-9de0d6ba72db admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.683238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b292cea-d16f-45c3-a5e6-9de0d6ba72db admin admin] PATH_INFO: `/v3/projects/d0ccacb2c65c424c9b495c3d5d7cc302/users/ebbe2b6779344a18a6e5875eade6a3ff/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.699223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b292cea-d16f-45c3-a5e6-9de0d6ba72db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ccacb2c65c424c9b495c3d5d7cc302, user_id=ebbe2b6779344a18a6e5875eade6a3ff, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:41.702127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b292cea-d16f-45c3-a5e6-9de0d6ba72db admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:41.847489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1051/2118] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:41 2022] PUT /identity/v3/projects/d0ccacb2c65c424c9b495c3d5d7cc302/users/ebbe2b6779344a18a6e5875eade6a3ff/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:41.850479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d963a0-7c91-487d-846d-2fdc684357d4 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:41.864751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d963a0-7c91-487d-846d-2fdc684357d4 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:41.953080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced7b9b-8569-4d74-908f-dadbb6d1f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:41.953708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7b9b-8569-4d74-908f-dadbb6d1f864 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.953987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7b9b-8569-4d74-908f-dadbb6d1f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.954263 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7b9b-8569-4d74-908f-dadbb6d1f864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.954944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced7b9b-8569-4d74-908f-dadbb6d1f864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:41.956849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced7b9b-8569-4d74-908f-dadbb6d1f864 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:41.968808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1068/2119] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:41.974336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b292cea-d16f-45c3-a5e6-9de0d6ba72db admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:41.985184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b292cea-d16f-45c3-a5e6-9de0d6ba72db admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:41.990147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1448080-7fbb-4679-9f58-cf16456241c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:41.990805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1448080-7fbb-4679-9f58-cf16456241c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:41.991140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1448080-7fbb-4679-9f58-cf16456241c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:41.991388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1448080-7fbb-4679-9f58-cf16456241c1 admin admin] PATH_INFO: `/v3/projects/d0ccacb2c65c424c9b495c3d5d7cc302/users/ebbe2b6779344a18a6e5875eade6a3ff/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:41.994030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1448080-7fbb-4679-9f58-cf16456241c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ccacb2c65c424c9b495c3d5d7cc302, user_id=ebbe2b6779344a18a6e5875eade6a3ff, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:41.996542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1448080-7fbb-4679-9f58-cf16456241c1 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:42.009906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1052/2120] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:41 2022] PUT /identity/v3/projects/d0ccacb2c65c424c9b495c3d5d7cc302/users/ebbe2b6779344a18a6e5875eade6a3ff/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:42.019876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df450-0d86-4aeb-9660-0f07d1d950fd None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:42.020740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df450-0d86-4aeb-9660-0f07d1d950fd None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:42.020961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df450-0d86-4aeb-9660-0f07d1d950fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:42.051683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-212df450-0d86-4aeb-9660-0f07d1d950fd None None] MFA Rules not processed for user `ebbe2b6779344a18a6e5875eade6a3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:42.053045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-212df450-0d86-4aeb-9660-0f07d1d950fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:42.139662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1069/2121] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:42.154055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1448080-7fbb-4679-9f58-cf16456241c1 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:42.158090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d1448080-7fbb-4679-9f58-cf16456241c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:42.248081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1448080-7fbb-4679-9f58-cf16456241c1 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:42.252622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784387b2-c24d-4863-90c5-85fb1345a82e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:42.253222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784387b2-c24d-4863-90c5-85fb1345a82e service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:42.253501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784387b2-c24d-4863-90c5-85fb1345a82e service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:42.253777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784387b2-c24d-4863-90c5-85fb1345a82e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:42.264613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784387b2-c24d-4863-90c5-85fb1345a82e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:42.266156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784387b2-c24d-4863-90c5-85fb1345a82e service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:42.276902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1053/2122] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:42.446211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df450-0d86-4aeb-9660-0f07d1d950fd None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:42.446211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:42.446211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df450-0d86-4aeb-9660-0f07d1d950fd None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:42.446211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:42.447220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:42.447220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:42.447220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] PATH_INFO: `/v3/users/28211b4ba1a74056aaf39f981a1529dc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:42.447220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28211b4ba1a74056aaf39f981a1529dc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:42.447220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:42.804864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28211b4ba1a74056aaf39f981a1529dc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:42.805624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28211b4ba1a74056aaf39f981a1529dc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:42.919284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28211b4ba1a74056aaf39f981a1529dc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:42.919984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28211b4ba1a74056aaf39f981a1529dc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:42.928590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28211b4ba1a74056aaf39f981a1529dc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:42.946459 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1070/2123] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:42 2022] DELETE /identity/v3/users/28211b4ba1a74056aaf39f981a1529dc => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:42.950850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465abcb-82ec-4b5b-9a2b-6c29f379ef09 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:42.951347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465abcb-82ec-4b5b-9a2b-6c29f379ef09 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:42.951516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465abcb-82ec-4b5b-9a2b-6c29f379ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:42.971458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d465abcb-82ec-4b5b-9a2b-6c29f379ef09 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:42.973735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d465abcb-82ec-4b5b-9a2b-6c29f379ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:43.045977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1054/2124] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:43.060850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:43.062338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:43.133946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85ae2f-d7f7-4070-aaf0-01592ae6def9 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:43.137659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f9378-1a69-467a-a750-836f6036515a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:43.138271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f9378-1a69-467a-a750-836f6036515a service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:43.138554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f9378-1a69-467a-a750-836f6036515a service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:43.138830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f9378-1a69-467a-a750-836f6036515a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:43.149643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f9378-1a69-467a-a750-836f6036515a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:43.151019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f9378-1a69-467a-a750-836f6036515a service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:43.167842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1071/2125] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:43.693300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465abcb-82ec-4b5b-9a2b-6c29f379ef09 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:43.695725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d465abcb-82ec-4b5b-9a2b-6c29f379ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:43.720365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465abcb-82ec-4b5b-9a2b-6c29f379ef09 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:43.726116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:43.726809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:43.727051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:43.727376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] PATH_INFO: `/v3/projects/cf714b05580d405a94bf6a87ac7b5456` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:43.728666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf714b05580d405a94bf6a87ac7b5456)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:43.730628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:43.753126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:43.892199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf714b05580d405a94bf6a87ac7b5456', 'request_id': 'req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:43.898652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf714b05580d405a94bf6a87ac7b5456', 'request_id': 'req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:43.971987 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf714b05580d405a94bf6a87ac7b5456', 'request_id': 'req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:43.986287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] The token cache is being invalidate because project cf714b05580d405a94bf6a87ac7b5456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:43.986586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:43.987372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:43.989550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1055/2126] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:43 2022] DELETE /identity/v3/projects/cf714b05580d405a94bf6a87ac7b5456 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:43.993678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f9378-1a69-467a-a750-836f6036515a service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:44.004249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f9378-1a69-467a-a750-836f6036515a service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:44.050351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:44.065987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:44.066677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:44.066992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:44.067261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] PATH_INFO: `/v3/users/ebbe2b6779344a18a6e5875eade6a3ff` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:44.068443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebbe2b6779344a18a6e5875eade6a3ff)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:44.070339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:44.291802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebbe2b6779344a18a6e5875eade6a3ff'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:44.292933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebbe2b6779344a18a6e5875eade6a3ff'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:44.395851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebbe2b6779344a18a6e5875eade6a3ff'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:44.401371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebbe2b6779344a18a6e5875eade6a3ff'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:44.410104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-997e33b8-cd01-4f9e-b2b9-3e1c0ea60d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebbe2b6779344a18a6e5875eade6a3ff'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:44.434619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1072/2127] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:43 2022] DELETE /identity/v3/users/ebbe2b6779344a18a6e5875eade6a3ff => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:44.953386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:44.955082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:44.969661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc96f5-48d8-4c8e-90b9-ca25fbbd0c27 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:45.057150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:45.058443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:45.058730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:45.059014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] PATH_INFO: `/v3/projects/d0ccacb2c65c424c9b495c3d5d7cc302` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:45.060439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ccacb2c65c424c9b495c3d5d7cc302)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:45.062357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:45.214665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ccacb2c65c424c9b495c3d5d7cc302', 'request_id': 'req-abecc321-7d07-4243-9694-9e8ba2f36503'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:45.221711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ccacb2c65c424c9b495c3d5d7cc302', 'request_id': 'req-abecc321-7d07-4243-9694-9e8ba2f36503'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:45.236822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fa6f1-80cb-41ea-ab2b-09221a0d2100 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:45.236822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fa6f1-80cb-41ea-ab2b-09221a0d2100 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:45.236822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fa6f1-80cb-41ea-ab2b-09221a0d2100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:45.256497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-421fa6f1-80cb-41ea-ab2b-09221a0d2100 None None] MFA Rules not processed for user `0660de8e84894260b053754e90725562`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:45.257735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-421fa6f1-80cb-41ea-ab2b-09221a0d2100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:45.314293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1073/2128] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:45.359253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ccacb2c65c424c9b495c3d5d7cc302', 'request_id': 'req-abecc321-7d07-4243-9694-9e8ba2f36503'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:45.375107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] The token cache is being invalidate because project d0ccacb2c65c424c9b495c3d5d7cc302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:45.375404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:45.376127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-abecc321-7d07-4243-9694-9e8ba2f36503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:45.377626 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1056/2129] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:44 2022] DELETE /identity/v3/projects/d0ccacb2c65c424c9b495c3d5d7cc302 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:45.382771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689c156-2916-4da1-afad-3edd88f44a54 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:45.383059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689c156-2916-4da1-afad-3edd88f44a54 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:45.383423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689c156-2916-4da1-afad-3edd88f44a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:45.403831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e689c156-2916-4da1-afad-3edd88f44a54 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:45.405107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e689c156-2916-4da1-afad-3edd88f44a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:45.472338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1074/2130] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:45.480646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b7b85-29a0-4355-834b-05bdadc62240 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:45.480936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b7b85-29a0-4355-834b-05bdadc62240 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:45.481237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b7b85-29a0-4355-834b-05bdadc62240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:45.504314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-226b7b85-29a0-4355-834b-05bdadc62240 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:45.506363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-226b7b85-29a0-4355-834b-05bdadc62240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:45.519528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1057/2131] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:45.521059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689c156-2916-4da1-afad-3edd88f44a54 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:45.536908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689c156-2916-4da1-afad-3edd88f44a54 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:45.542372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78351f87-65b3-4843-8b44-a1889084dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:45.542994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78351f87-65b3-4843-8b44-a1889084dd60 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:45.543321 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78351f87-65b3-4843-8b44-a1889084dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:45.543771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78351f87-65b3-4843-8b44-a1889084dd60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:45.544421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78351f87-65b3-4843-8b44-a1889084dd60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:45.544728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78351f87-65b3-4843-8b44-a1889084dd60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:45.546539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78351f87-65b3-4843-8b44-a1889084dd60 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:45.560308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:45.568050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1075/2132] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:19:45.569572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b7b85-29a0-4355-834b-05bdadc62240 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:45.579500 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b7b85-29a0-4355-834b-05bdadc62240 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:45.588978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88bc09-dd84-43b8-9286-e3d49ffb5475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:45.591004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88bc09-dd84-43b8-9286-e3d49ffb5475 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:45.591004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88bc09-dd84-43b8-9286-e3d49ffb5475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:45.591611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88bc09-dd84-43b8-9286-e3d49ffb5475 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:45.594002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88bc09-dd84-43b8-9286-e3d49ffb5475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:45.596706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88bc09-dd84-43b8-9286-e3d49ffb5475 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:45.771739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78351f87-65b3-4843-8b44-a1889084dd60 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:45.781517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1058/2133] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:45 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:45.792926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78351f87-65b3-4843-8b44-a1889084dd60 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:45.869656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b089be-5050-4bb2-97e3-f164bdd12024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:45.870436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b089be-5050-4bb2-97e3-f164bdd12024 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:45.870725 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b089be-5050-4bb2-97e3-f164bdd12024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:45.870999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b089be-5050-4bb2-97e3-f164bdd12024 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:45.871741 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b089be-5050-4bb2-97e3-f164bdd12024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:45.877203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b089be-5050-4bb2-97e3-f164bdd12024 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:45.966582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1076/2134] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:45 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:45.971035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88bc09-dd84-43b8-9286-e3d49ffb5475 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:45.978054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:45.983585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88bc09-dd84-43b8-9286-e3d49ffb5475 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:45.990986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a0e3f-5316-4764-8415-690958d78f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:45.991748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a0e3f-5316-4764-8415-690958d78f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:45.992030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a0e3f-5316-4764-8415-690958d78f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:45.992482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a0e3f-5316-4764-8415-690958d78f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:45.993157 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a0e3f-5316-4764-8415-690958d78f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:45.994757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a0e3f-5316-4764-8415-690958d78f98 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:46.005452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1059/2135] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:46.009519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b089be-5050-4bb2-97e3-f164bdd12024 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:46.021613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b089be-5050-4bb2-97e3-f164bdd12024 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:46.026358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53162df4-d6fb-4b08-b2ed-2ec5c829378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:46.026973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53162df4-d6fb-4b08-b2ed-2ec5c829378c admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:46.027338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53162df4-d6fb-4b08-b2ed-2ec5c829378c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:46.027638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53162df4-d6fb-4b08-b2ed-2ec5c829378c admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:46.028358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53162df4-d6fb-4b08-b2ed-2ec5c829378c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:46.029944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53162df4-d6fb-4b08-b2ed-2ec5c829378c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:46.042638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1077/2136] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:46.046933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a0e3f-5316-4764-8415-690958d78f98 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:46.058049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a0e3f-5316-4764-8415-690958d78f98 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:46.063265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438d56-9f3d-436f-91ce-471ee1e08a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:46.063974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438d56-9f3d-436f-91ce-471ee1e08a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:46.064260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438d56-9f3d-436f-91ce-471ee1e08a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:46.064702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438d56-9f3d-436f-91ce-471ee1e08a84 admin admin] PATH_INFO: `/v3/projects/935edfca5cd54ce79b133adbb37b99b2/users/7fb4cd538c494a25a620af5d63993a39/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:46.081727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e438d56-9f3d-436f-91ce-471ee1e08a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935edfca5cd54ce79b133adbb37b99b2, user_id=7fb4cd538c494a25a620af5d63993a39, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:46.095203 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e438d56-9f3d-436f-91ce-471ee1e08a84 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:46.203670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1060/2137] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:46 2022] PUT /identity/v3/projects/935edfca5cd54ce79b133adbb37b99b2/users/7fb4cd538c494a25a620af5d63993a39/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:46.210615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5021f-65f9-4691-b171-b0fae11a8d81 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:46.210982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5021f-65f9-4691-b171-b0fae11a8d81 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:46.211258 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5021f-65f9-4691-b171-b0fae11a8d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:46.248446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-76b5021f-65f9-4691-b171-b0fae11a8d81 None None] MFA Rules not processed for user `7fb4cd538c494a25a620af5d63993a39`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:46.249920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-76b5021f-65f9-4691-b171-b0fae11a8d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:46.333800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1078/2138] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:46.341021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438d56-9f3d-436f-91ce-471ee1e08a84 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:46.408644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438d56-9f3d-436f-91ce-471ee1e08a84 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:46.413453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4445cf-a8be-41e6-a5ad-77f777083929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:46.414061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4445cf-a8be-41e6-a5ad-77f777083929 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:46.414340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4445cf-a8be-41e6-a5ad-77f777083929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:46.414613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4445cf-a8be-41e6-a5ad-77f777083929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:46.415295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4445cf-a8be-41e6-a5ad-77f777083929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:46.417225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4445cf-a8be-41e6-a5ad-77f777083929 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:46.522948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1061/2139] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:46 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:46.524343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5021f-65f9-4691-b171-b0fae11a8d81 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:46.538043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5021f-65f9-4691-b171-b0fae11a8d81 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:46.608886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148565-508a-4971-903c-c1979b044c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:46.609546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148565-508a-4971-903c-c1979b044c09 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:46.609833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148565-508a-4971-903c-c1979b044c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:46.610133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148565-508a-4971-903c-c1979b044c09 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:46.610871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148565-508a-4971-903c-c1979b044c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:46.614304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148565-508a-4971-903c-c1979b044c09 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:46.716719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:46.720829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1079/2140] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:46 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:46.727587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4445cf-a8be-41e6-a5ad-77f777083929 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:46.730687 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428c7a1-528c-4e7d-bee2-187b8a8ee4f1 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:46.730981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428c7a1-528c-4e7d-bee2-187b8a8ee4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:46.731257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428c7a1-528c-4e7d-bee2-187b8a8ee4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:46.739444 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4445cf-a8be-41e6-a5ad-77f777083929 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:46.749308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d2a39-aa30-4dcc-9d64-7be00e480362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:46.749925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d2a39-aa30-4dcc-9d64-7be00e480362 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:46.750208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d2a39-aa30-4dcc-9d64-7be00e480362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:46.750484 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d2a39-aa30-4dcc-9d64-7be00e480362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:46.751181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d2a39-aa30-4dcc-9d64-7be00e480362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:46.752929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d2a39-aa30-4dcc-9d64-7be00e480362 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:46.753924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5428c7a1-528c-4e7d-bee2-187b8a8ee4f1 None None] MFA Rules not processed for user `be0f76350dc148c6b51705693a1902c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:46.755885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5428c7a1-528c-4e7d-bee2-187b8a8ee4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:46.773820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1062/2141] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:46.773820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d2a39-aa30-4dcc-9d64-7be00e480362 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:46.786733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d2a39-aa30-4dcc-9d64-7be00e480362 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:46.793946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cdf15-4a48-4242-a198-16bcc8af445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:46.794637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cdf15-4a48-4242-a198-16bcc8af445a admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:46.794922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cdf15-4a48-4242-a198-16bcc8af445a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:46.795219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cdf15-4a48-4242-a198-16bcc8af445a admin admin] PATH_INFO: `/v3/projects/0e4a6e5080974ab49491346b94af3da2/users/8fd4685025e944559a8d453eb0923b73/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:46.813162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cdf15-4a48-4242-a198-16bcc8af445a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4a6e5080974ab49491346b94af3da2, user_id=8fd4685025e944559a8d453eb0923b73, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:46.817879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cdf15-4a48-4242-a198-16bcc8af445a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:46.831800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1080/2142] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:46.918137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1063/2143] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:46 2022] PUT /identity/v3/projects/0e4a6e5080974ab49491346b94af3da2/users/8fd4685025e944559a8d453eb0923b73/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:19:46.923047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428c7a1-528c-4e7d-bee2-187b8a8ee4f1 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:46.936735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428c7a1-528c-4e7d-bee2-187b8a8ee4f1 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:47.007531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a205a7-e3a8-4cc2-bff6-e5bcf0ee6596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:47.007531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a205a7-e3a8-4cc2-bff6-e5bcf0ee6596 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:47.007531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a205a7-e3a8-4cc2-bff6-e5bcf0ee6596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:47.007531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a205a7-e3a8-4cc2-bff6-e5bcf0ee6596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:47.007979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a205a7-e3a8-4cc2-bff6-e5bcf0ee6596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:47.007979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a205a7-e3a8-4cc2-bff6-e5bcf0ee6596 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:47.019656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1081/2144] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:47.022024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cdf15-4a48-4242-a198-16bcc8af445a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:47.034613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cdf15-4a48-4242-a198-16bcc8af445a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:47.040233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6316-10ea-4cd4-8b95-6290789e6600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:47.040991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6316-10ea-4cd4-8b95-6290789e6600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:47.041513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6316-10ea-4cd4-8b95-6290789e6600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:47.041864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6316-10ea-4cd4-8b95-6290789e6600 admin admin] PATH_INFO: `/v3/projects/0e4a6e5080974ab49491346b94af3da2/users/8fd4685025e944559a8d453eb0923b73/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:47.043929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe6316-10ea-4cd4-8b95-6290789e6600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4a6e5080974ab49491346b94af3da2, user_id=8fd4685025e944559a8d453eb0923b73, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:47.046777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe6316-10ea-4cd4-8b95-6290789e6600 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:47.059166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1064/2145] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:47 2022] PUT /identity/v3/projects/0e4a6e5080974ab49491346b94af3da2/users/8fd4685025e944559a8d453eb0923b73/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:47.070448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef1cb-029f-4524-837f-898bec3efcb0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:47.070747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef1cb-029f-4524-837f-898bec3efcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:47.071004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef1cb-029f-4524-837f-898bec3efcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:47.100724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b51ef1cb-029f-4524-837f-898bec3efcb0 None None] MFA Rules not processed for user `8fd4685025e944559a8d453eb0923b73`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:47.102104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b51ef1cb-029f-4524-837f-898bec3efcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:47.185936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1082/2146] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:47.199104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6316-10ea-4cd4-8b95-6290789e6600 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:47.206123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e0fe6316-10ea-4cd4-8b95-6290789e6600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:47.273783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6316-10ea-4cd4-8b95-6290789e6600 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:47.277526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735b97-5e30-4374-a0b0-c5db8d4e1fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:47.278133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735b97-5e30-4374-a0b0-c5db8d4e1fdf service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:47.278525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735b97-5e30-4374-a0b0-c5db8d4e1fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:47.278710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735b97-5e30-4374-a0b0-c5db8d4e1fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:47.291785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735b97-5e30-4374-a0b0-c5db8d4e1fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:47.293302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735b97-5e30-4374-a0b0-c5db8d4e1fdf service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:47.304195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1065/2147] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:47.455714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ef1cb-029f-4524-837f-898bec3efcb0 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:47.466531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ef1cb-029f-4524-837f-898bec3efcb0 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:47.470676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcc95c-20d8-4e51-812a-0c78d2c0e101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:47.471294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcc95c-20d8-4e51-812a-0c78d2c0e101 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:47.471574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcc95c-20d8-4e51-812a-0c78d2c0e101 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:47.471881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcc95c-20d8-4e51-812a-0c78d2c0e101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:47.495775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:47.535563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcc95c-20d8-4e51-812a-0c78d2c0e101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:47.537034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcc95c-20d8-4e51-812a-0c78d2c0e101 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:47.550074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1083/2148] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:48.135728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735b97-5e30-4374-a0b0-c5db8d4e1fdf service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:48.144699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:48.268883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735b97-5e30-4374-a0b0-c5db8d4e1fdf service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:48.286135 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:48.286911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:48.291192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:48.291192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] PATH_INFO: `/v3/users/7fb4cd538c494a25a620af5d63993a39` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:48.291811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb4cd538c494a25a620af5d63993a39)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:48.297774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:48.731424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb4cd538c494a25a620af5d63993a39'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:48.800337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb4cd538c494a25a620af5d63993a39'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:48.817464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb4cd538c494a25a620af5d63993a39'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:48.818582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb4cd538c494a25a620af5d63993a39'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:48.826922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb4cd538c494a25a620af5d63993a39'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:48.833793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1066/2149] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:48 2022] DELETE /identity/v3/users/7fb4cd538c494a25a620af5d63993a39 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:48.838286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea7cd3-8bc5-4d91-a433-2d5188823bb1 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:48.838774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea7cd3-8bc5-4d91-a433-2d5188823bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:48.838876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea7cd3-8bc5-4d91-a433-2d5188823bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:48.858144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f2ea7cd3-8bc5-4d91-a433-2d5188823bb1 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:48.859463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f2ea7cd3-8bc5-4d91-a433-2d5188823bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:48.955738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1084/2150] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:48.968760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:48.968760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:49.030103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fea45-d9b0-4217-8eba-a9a696a0f813 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:49.033670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649896b-7d7a-4776-a140-a6f84aa0c4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:49.034274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649896b-7d7a-4776-a140-a6f84aa0c4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:49.034558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649896b-7d7a-4776-a140-a6f84aa0c4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:49.034839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649896b-7d7a-4776-a140-a6f84aa0c4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:49.044607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649896b-7d7a-4776-a140-a6f84aa0c4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:49.046040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649896b-7d7a-4776-a140-a6f84aa0c4e1 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:49.060748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1067/2151] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:49.468703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea7cd3-8bc5-4d91-a433-2d5188823bb1 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:49.472442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f2ea7cd3-8bc5-4d91-a433-2d5188823bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:49.495740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea7cd3-8bc5-4d91-a433-2d5188823bb1 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:49.506907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:49.512662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:49.512662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:49.512662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] PATH_INFO: `/v3/projects/935edfca5cd54ce79b133adbb37b99b2` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:49.512662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] RBAC: Authorizing `identity:delete_project(project_id=935edfca5cd54ce79b133adbb37b99b2)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:49.515713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:49.669063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935edfca5cd54ce79b133adbb37b99b2', 'request_id': 'req-f29ff219-c224-4d56-8255-9eab2636855a'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:49.778102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935edfca5cd54ce79b133adbb37b99b2', 'request_id': 'req-f29ff219-c224-4d56-8255-9eab2636855a'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:49.787743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935edfca5cd54ce79b133adbb37b99b2', 'request_id': 'req-f29ff219-c224-4d56-8255-9eab2636855a'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:49.816640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] The token cache is being invalidate because project 935edfca5cd54ce79b133adbb37b99b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:49.817938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:49.818924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:49.822190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1085/2152] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:49 2022] DELETE /identity/v3/projects/935edfca5cd54ce79b133adbb37b99b2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:49.826512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649896b-7d7a-4776-a140-a6f84aa0c4e1 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:49.842535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649896b-7d7a-4776-a140-a6f84aa0c4e1 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:49.876137 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:49.911911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:49.912820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:49.913106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:49.913388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] PATH_INFO: `/v3/users/8fd4685025e944559a8d453eb0923b73` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:49.914546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd4685025e944559a8d453eb0923b73)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:49.916517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:50.149947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd4685025e944559a8d453eb0923b73'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:50.251615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd4685025e944559a8d453eb0923b73'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:50.274029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd4685025e944559a8d453eb0923b73'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:50.274777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd4685025e944559a8d453eb0923b73'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:50.288424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd4685025e944559a8d453eb0923b73'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:50.295553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1068/2153] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:49 2022] DELETE /identity/v3/users/8fd4685025e944559a8d453eb0923b73 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:50.785586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:50.787292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:50.805989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ff219-c224-4d56-8255-9eab2636855a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:50.872531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:50.888336 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:50.889074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:50.890094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:50.890565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] PATH_INFO: `/v3/projects/0e4a6e5080974ab49491346b94af3da2` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:50.891775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4a6e5080974ab49491346b94af3da2)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:50.893679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:51.034917 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4a6e5080974ab49491346b94af3da2', 'request_id': 'req-db5c8427-051e-469a-96a0-d8fb41999514'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.125077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4a6e5080974ab49491346b94af3da2', 'request_id': 'req-db5c8427-051e-469a-96a0-d8fb41999514'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.134727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4a6e5080974ab49491346b94af3da2', 'request_id': 'req-db5c8427-051e-469a-96a0-d8fb41999514'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.144064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:51.145577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:51.168593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcc0f9-3afa-4fca-aa7d-bea10468b52b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:51.179171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] The token cache is being invalidate because project 0e4a6e5080974ab49491346b94af3da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:51.179719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.181638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-db5c8427-051e-469a-96a0-d8fb41999514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.182889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1086/2154] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:50 2022] DELETE /identity/v3/projects/0e4a6e5080974ab49491346b94af3da2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:51.190806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cc9a4-ae89-4429-8024-d8af58d9f9e2 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:51.191277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cc9a4-ae89-4429-8024-d8af58d9f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:51.191680 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cc9a4-ae89-4429-8024-d8af58d9f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:51.242402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-c04cc9a4-ae89-4429-8024-d8af58d9f9e2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:51.243936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c04cc9a4-ae89-4429-8024-d8af58d9f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:51.259321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:51.260687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:51.261006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:51.261343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] PATH_INFO: `/v3/users/e3345f6aba4c4e1aba1c094d032a9ae9` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:51.263500 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3345f6aba4c4e1aba1c094d032a9ae9)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:51.265524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:51.320831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1087/2155] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:51.328975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a3769-7a7a-4392-a6e3-59e514544c2f None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:51.329299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a3769-7a7a-4392-a6e3-59e514544c2f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:51.329528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a3769-7a7a-4392-a6e3-59e514544c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:51.362634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-a85a3769-7a7a-4392-a6e3-59e514544c2f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:51.364727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a85a3769-7a7a-4392-a6e3-59e514544c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:51.399886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1088/2156] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:51.399886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a3769-7a7a-4392-a6e3-59e514544c2f None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:51.420102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a3769-7a7a-4392-a6e3-59e514544c2f None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:51.434084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ba7ab-ebd9-4b48-8c29-764720a025fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:51.435918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ba7ab-ebd9-4b48-8c29-764720a025fa admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:51.437304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ba7ab-ebd9-4b48-8c29-764720a025fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:51.437587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ba7ab-ebd9-4b48-8c29-764720a025fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:51.438253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ba7ab-ebd9-4b48-8c29-764720a025fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:51.438555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ba7ab-ebd9-4b48-8c29-764720a025fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:51.440606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ba7ab-ebd9-4b48-8c29-764720a025fa admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:51.485474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1089/2157] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:19:51.498738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ba7ab-ebd9-4b48-8c29-764720a025fa admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:51.512057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3345f6aba4c4e1aba1c094d032a9ae9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.522127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:51.526484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ba7ab-ebd9-4b48-8c29-764720a025fa admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:51.537308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a92c3-8c19-4376-90b7-99345e4d1816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:51.537308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a92c3-8c19-4376-90b7-99345e4d1816 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:51.537308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a92c3-8c19-4376-90b7-99345e4d1816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:51.537308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a92c3-8c19-4376-90b7-99345e4d1816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:51.538388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a92c3-8c19-4376-90b7-99345e4d1816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:51.538388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a92c3-8c19-4376-90b7-99345e4d1816 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:51.639094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3345f6aba4c4e1aba1c094d032a9ae9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.657144 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3345f6aba4c4e1aba1c094d032a9ae9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.658167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3345f6aba4c4e1aba1c094d032a9ae9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.668401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1090/2158] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:51 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:51.669159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cb81f26b-5b23-40e8-8028-994cfa755d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3345f6aba4c4e1aba1c094d032a9ae9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:51.671735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a92c3-8c19-4376-90b7-99345e4d1816 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:51.675415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a42a92c3-8c19-4376-90b7-99345e4d1816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:51.678622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1069/2159] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:19:51 2022] DELETE /identity/v3/users/e3345f6aba4c4e1aba1c094d032a9ae9 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:51.687524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4199e-052a-447e-a6d6-0ebaa708d195 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:51.688846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4199e-052a-447e-a6d6-0ebaa708d195 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:51.689233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4199e-052a-447e-a6d6-0ebaa708d195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:51.734194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-7cc4199e-052a-447e-a6d6-0ebaa708d195 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:51.736259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7cc4199e-052a-447e-a6d6-0ebaa708d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:51.801903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a92c3-8c19-4376-90b7-99345e4d1816 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:51.864575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1070/2160] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:19:51.878439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4199e-052a-447e-a6d6-0ebaa708d195 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:51.880376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7cc4199e-052a-447e-a6d6-0ebaa708d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:51.920432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638b78-d7d2-4d2f-b320-96a3632620b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:51.925262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638b78-d7d2-4d2f-b320-96a3632620b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:51.925262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638b78-d7d2-4d2f-b320-96a3632620b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:51.925262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638b78-d7d2-4d2f-b320-96a3632620b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:51.925262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20638b78-d7d2-4d2f-b320-96a3632620b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:51.925262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20638b78-d7d2-4d2f-b320-96a3632620b0 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:51.952463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4199e-052a-447e-a6d6-0ebaa708d195 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:51.956601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5a1d0-4e89-4525-8f00-01eb84a415ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:51.958366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5a1d0-4e89-4525-8f00-01eb84a415ec service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:51.958753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5a1d0-4e89-4525-8f00-01eb84a415ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:51.959124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5a1d0-4e89-4525-8f00-01eb84a415ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:51.969316 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5a1d0-4e89-4525-8f00-01eb84a415ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:51.970743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5a1d0-4e89-4525-8f00-01eb84a415ec service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:51.981148 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1071/2161] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:19:52.044007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1091/2162] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:51 2022] POST /identity/v3/users => generated 286 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:52.048912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5a1d0-4e89-4525-8f00-01eb84a415ec service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:52.061024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5a1d0-4e89-4525-8f00-01eb84a415ec service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:52.069482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c146a8e-2210-4df5-81b6-4d0ec03eae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:52.074646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c146a8e-2210-4df5-81b6-4d0ec03eae8f admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:52.074646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c146a8e-2210-4df5-81b6-4d0ec03eae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:52.074646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c146a8e-2210-4df5-81b6-4d0ec03eae8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:52.074646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c146a8e-2210-4df5-81b6-4d0ec03eae8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:52.074646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c146a8e-2210-4df5-81b6-4d0ec03eae8f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:52.092167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638b78-d7d2-4d2f-b320-96a3632620b0 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:52.093704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1072/2163] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:52.106389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638b78-d7d2-4d2f-b320-96a3632620b0 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:52.126350 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0625b15-1ead-4fd4-b62a-67abe5a07d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:52.127174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0625b15-1ead-4fd4-b62a-67abe5a07d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:52.127609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0625b15-1ead-4fd4-b62a-67abe5a07d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:52.127918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0625b15-1ead-4fd4-b62a-67abe5a07d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:52.128574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0625b15-1ead-4fd4-b62a-67abe5a07d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:52.132055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0625b15-1ead-4fd4-b62a-67abe5a07d10 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:52.151118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1092/2164] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:19:52.152710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c146a8e-2210-4df5-81b6-4d0ec03eae8f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:52.166346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c146a8e-2210-4df5-81b6-4d0ec03eae8f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:52.171793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aca13-953b-4520-9ec3-2b680a889355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:52.172609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aca13-953b-4520-9ec3-2b680a889355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:52.172944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aca13-953b-4520-9ec3-2b680a889355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:52.173225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aca13-953b-4520-9ec3-2b680a889355 admin admin] PATH_INFO: `/v3/projects/5df2a1a2d0634e9797575c18665352f3/users/d7488acd4079403398b0f0c2e22905f3/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:52.208420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aca13-953b-4520-9ec3-2b680a889355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df2a1a2d0634e9797575c18665352f3, user_id=d7488acd4079403398b0f0c2e22905f3, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:52.212577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aca13-953b-4520-9ec3-2b680a889355 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:52.263695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:52.324457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1073/2165] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:52 2022] PUT /identity/v3/projects/5df2a1a2d0634e9797575c18665352f3/users/d7488acd4079403398b0f0c2e22905f3/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:52.336419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd1e04-f951-4075-91c4-68a2b7046d1b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:52.336922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd1e04-f951-4075-91c4-68a2b7046d1b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:52.337944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd1e04-f951-4075-91c4-68a2b7046d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:52.373731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-54dd1e04-f951-4075-91c4-68a2b7046d1b None None] MFA Rules not processed for user `d7488acd4079403398b0f0c2e22905f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:52.375044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-54dd1e04-f951-4075-91c4-68a2b7046d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:52.471237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1093/2166] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:52.478559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aca13-953b-4520-9ec3-2b680a889355 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:52.480716 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9a5aca13-953b-4520-9ec3-2b680a889355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:52.563430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aca13-953b-4520-9ec3-2b680a889355 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:52.568139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8430860-f9ae-4670-8fec-ae1da2548581 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'decb5421872c4034bbbaa8c3cd9dcb5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:52.568764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8430860-f9ae-4670-8fec-ae1da2548581 service glance] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:52.569329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8430860-f9ae-4670-8fec-ae1da2548581 service glance] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:52.569615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8430860-f9ae-4670-8fec-ae1da2548581 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:52.584115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8430860-f9ae-4670-8fec-ae1da2548581 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:52.586413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8430860-f9ae-4670-8fec-ae1da2548581 service glance] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:52.597927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1074/2167] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:19:52.703390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd1e04-f951-4075-91c4-68a2b7046d1b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:52.705627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-54dd1e04-f951-4075-91c4-68a2b7046d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:52.918606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd1e04-f951-4075-91c4-68a2b7046d1b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:52.933382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:52.933382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:52.935866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:52.935866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] PATH_INFO: `/v3/projects/5cff2672d87b41929edf10cc098af3b6` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:52.936287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cff2672d87b41929edf10cc098af3b6)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:52.938454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:52.955143 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:53.054189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cff2672d87b41929edf10cc098af3b6', 'request_id': 'req-efeeae96-b4af-4805-92fb-19a68611ed7d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:53.166591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cff2672d87b41929edf10cc098af3b6', 'request_id': 'req-efeeae96-b4af-4805-92fb-19a68611ed7d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:53.175943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cff2672d87b41929edf10cc098af3b6', 'request_id': 'req-efeeae96-b4af-4805-92fb-19a68611ed7d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:53.191599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] The token cache is being invalidate because project 5cff2672d87b41929edf10cc098af3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:19:53.191959 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:53.192801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-efeeae96-b4af-4805-92fb-19a68611ed7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:19:53.197798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1094/2168] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:19:52 2022] DELETE /identity/v3/projects/5cff2672d87b41929edf10cc098af3b6 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:53.199461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4589e-4406-439c-94b0-ac3291bf262b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:53.199996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4589e-4406-439c-94b0-ac3291bf262b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:53.200093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4589e-4406-439c-94b0-ac3291bf262b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:53.231666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-61a4589e-4406-439c-94b0-ac3291bf262b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:53.233213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-61a4589e-4406-439c-94b0-ac3291bf262b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:53.362439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1075/2169] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:53.370181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7873-f4ed-4052-beb5-5665ef906577 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:53.370508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7873-f4ed-4052-beb5-5665ef906577 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:53.371141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7873-f4ed-4052-beb5-5665ef906577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:53.395414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3f8c7873-f4ed-4052-beb5-5665ef906577 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:53.396825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3f8c7873-f4ed-4052-beb5-5665ef906577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:53.406153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1095/2170] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:53.410613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4589e-4406-439c-94b0-ac3291bf262b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:53.426457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4589e-4406-439c-94b0-ac3291bf262b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:53.431221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72809-44d9-460e-9253-4055f5c0ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:53.432499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72809-44d9-460e-9253-4055f5c0ad25 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:53.433173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72809-44d9-460e-9253-4055f5c0ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:53.433464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72809-44d9-460e-9253-4055f5c0ad25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:53.434192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba72809-44d9-460e-9253-4055f5c0ad25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:19:53.434502 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba72809-44d9-460e-9253-4055f5c0ad25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:53.436283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba72809-44d9-460e-9253-4055f5c0ad25 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:53.460303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1076/2171] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:19:53.460975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7873-f4ed-4052-beb5-5665ef906577 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:53.480419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7873-f4ed-4052-beb5-5665ef906577 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:53.492844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ed7c6-ae44-4ac4-b342-8dcf3ac825e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:53.493476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed7c6-ae44-4ac4-b342-8dcf3ac825e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:53.493760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed7c6-ae44-4ac4-b342-8dcf3ac825e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:53.494038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed7c6-ae44-4ac4-b342-8dcf3ac825e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:53.494689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ed7c6-ae44-4ac4-b342-8dcf3ac825e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:53.496631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ed7c6-ae44-4ac4-b342-8dcf3ac825e4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:53.597345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1096/2172] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:19:53 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:19:53.599439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72809-44d9-460e-9253-4055f5c0ad25 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:53.649285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72809-44d9-460e-9253-4055f5c0ad25 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:53.664907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:53.802161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906ea26-2f80-408f-af11-f0caebff772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:53.802863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906ea26-2f80-408f-af11-f0caebff772f admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:53.803290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906ea26-2f80-408f-af11-f0caebff772f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:53.803615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906ea26-2f80-408f-af11-f0caebff772f admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:53.804450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906ea26-2f80-408f-af11-f0caebff772f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:53.809390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906ea26-2f80-408f-af11-f0caebff772f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:53.918463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1077/2173] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:19:53 2022] POST /identity/v3/users => generated 295 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:19:53.919689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ed7c6-ae44-4ac4-b342-8dcf3ac825e4 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:53.930019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ed7c6-ae44-4ac4-b342-8dcf3ac825e4 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:53.942208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532c0e2-cacb-43c7-9110-03ad574d7926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:53.942847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532c0e2-cacb-43c7-9110-03ad574d7926 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:53.943134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532c0e2-cacb-43c7-9110-03ad574d7926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:53.943412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532c0e2-cacb-43c7-9110-03ad574d7926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:53.944331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532c0e2-cacb-43c7-9110-03ad574d7926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:53.945932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532c0e2-cacb-43c7-9110-03ad574d7926 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:53.958209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1097/2174] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:53.962148 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906ea26-2f80-408f-af11-f0caebff772f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:53.972735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906ea26-2f80-408f-af11-f0caebff772f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:53.978167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e41575-b17b-4415-8c41-7aed8ed7e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:53.978776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41575-b17b-4415-8c41-7aed8ed7e77a admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:53.979057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41575-b17b-4415-8c41-7aed8ed7e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:53.979331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41575-b17b-4415-8c41-7aed8ed7e77a admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:53.980002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e41575-b17b-4415-8c41-7aed8ed7e77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:53.981659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e41575-b17b-4415-8c41-7aed8ed7e77a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:53.992890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1078/2175] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:19:53.996906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532c0e2-cacb-43c7-9110-03ad574d7926 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:54.007869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532c0e2-cacb-43c7-9110-03ad574d7926 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:54.012776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe76900-3a73-4469-8723-0c07760a0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:54.013441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe76900-3a73-4469-8723-0c07760a0af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:54.013728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe76900-3a73-4469-8723-0c07760a0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:54.014006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe76900-3a73-4469-8723-0c07760a0af8 admin admin] PATH_INFO: `/v3/projects/8885f89cedf24882b2cf83481f1eaa30/users/6593bf2b928d4e2a806c4a082cf03aae/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:54.030347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe76900-3a73-4469-8723-0c07760a0af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8885f89cedf24882b2cf83481f1eaa30, user_id=6593bf2b928d4e2a806c4a082cf03aae, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:54.033372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe76900-3a73-4469-8723-0c07760a0af8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:54.151098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1098/2176] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:19:53 2022] PUT /identity/v3/projects/8885f89cedf24882b2cf83481f1eaa30/users/6593bf2b928d4e2a806c4a082cf03aae/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:19:54.163652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2162de-22e5-47a0-86dd-bcf4fd143bd1 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:54.163935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2162de-22e5-47a0-86dd-bcf4fd143bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:54.164295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2162de-22e5-47a0-86dd-bcf4fd143bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:54.200441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-de2162de-22e5-47a0-86dd-bcf4fd143bd1 None None] MFA Rules not processed for user `6593bf2b928d4e2a806c4a082cf03aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:19:54.202398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-de2162de-22e5-47a0-86dd-bcf4fd143bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:54.318524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1079/2177] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:19:54.324456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:54.334515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe76900-3a73-4469-8723-0c07760a0af8 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:19:54.336608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7fe76900-3a73-4469-8723-0c07760a0af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:19:54.415744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe76900-3a73-4469-8723-0c07760a0af8 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:19:54.428035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b83b-6e40-4c56-80fe-6e84438242d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:19:54.428698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b83b-6e40-4c56-80fe-6e84438242d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:19:54.429273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b83b-6e40-4c56-80fe-6e84438242d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:19:54.429558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b83b-6e40-4c56-80fe-6e84438242d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:19:54.448509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3b83b-6e40-4c56-80fe-6e84438242d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:19:54.450113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3b83b-6e40-4c56-80fe-6e84438242d1 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:19:54.461139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1099/2178] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:20:03.065073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84671da-bf24-4b1a-84f0-30604991d981 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:03.065552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84671da-bf24-4b1a-84f0-30604991d981 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:03.065634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84671da-bf24-4b1a-84f0-30604991d981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:03.087641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e84671da-bf24-4b1a-84f0-30604991d981 None None] MFA Rules not processed for user `04c3b6e933a9414593d7552aa960967d`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:03.088924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e84671da-bf24-4b1a-84f0-30604991d981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:03.173034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1080/2179] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:04.803994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:06.806338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b83b-6e40-4c56-80fe-6e84438242d1 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:06.871306 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b83b-6e40-4c56-80fe-6e84438242d1 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:06.876007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:06.876638 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:06.876925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:06.877206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] PATH_INFO: `/v3/users/6593bf2b928d4e2a806c4a082cf03aae` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:06.878498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6593bf2b928d4e2a806c4a082cf03aae)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:06.880491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:07.100885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6593bf2b928d4e2a806c4a082cf03aae'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:07.101587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6593bf2b928d4e2a806c4a082cf03aae'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:07.195199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6593bf2b928d4e2a806c4a082cf03aae'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:07.195873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6593bf2b928d4e2a806c4a082cf03aae'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:07.203811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6593bf2b928d4e2a806c4a082cf03aae'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:07.222722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1100/2180] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:20:06 2022] DELETE /identity/v3/users/6593bf2b928d4e2a806c4a082cf03aae => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:07.227226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273dfc1-9a4b-4903-b30a-df4aeb79f104 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:07.228032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273dfc1-9a4b-4903-b30a-df4aeb79f104 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:07.228331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273dfc1-9a4b-4903-b30a-df4aeb79f104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:07.246920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-0273dfc1-9a4b-4903-b30a-df4aeb79f104 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:07.248158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0273dfc1-9a4b-4903-b30a-df4aeb79f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:07.306629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1081/2181] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:07.316572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:07.318014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:07.384548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491cf2e-3f95-417d-b528-fce5f5ac062d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:07.388139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b23ffe-3669-45b8-86b4-c1cb044dfb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:07.388745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b23ffe-3669-45b8-86b4-c1cb044dfb8c service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:07.389028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b23ffe-3669-45b8-86b4-c1cb044dfb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:07.389299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b23ffe-3669-45b8-86b4-c1cb044dfb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:07.398498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b23ffe-3669-45b8-86b4-c1cb044dfb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:07.399944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b23ffe-3669-45b8-86b4-c1cb044dfb8c service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:07.409125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1101/2182] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:20:07.951513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273dfc1-9a4b-4903-b30a-df4aeb79f104 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:07.953065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0273dfc1-9a4b-4903-b30a-df4aeb79f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:07.966937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273dfc1-9a4b-4903-b30a-df4aeb79f104 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:07.972129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:07.972739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:07.973764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:07.974073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] PATH_INFO: `/v3/projects/8885f89cedf24882b2cf83481f1eaa30` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:07.975818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8885f89cedf24882b2cf83481f1eaa30)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:07.977793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:08.075380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8885f89cedf24882b2cf83481f1eaa30', 'request_id': 'req-7f70f589-7a3f-4e26-99e8-863d15fd3de3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:08.081878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8885f89cedf24882b2cf83481f1eaa30', 'request_id': 'req-7f70f589-7a3f-4e26-99e8-863d15fd3de3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:08.193052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8885f89cedf24882b2cf83481f1eaa30', 'request_id': 'req-7f70f589-7a3f-4e26-99e8-863d15fd3de3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:08.205018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] The token cache is being invalidate because project 8885f89cedf24882b2cf83481f1eaa30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:20:08.205558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:08.206650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7f70f589-7a3f-4e26-99e8-863d15fd3de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:08.208350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1082/2183] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:20:07 2022] DELETE /identity/v3/projects/8885f89cedf24882b2cf83481f1eaa30 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:08.213896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d1e03-9a97-4a58-92b0-e9d83b9e5052 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:08.214382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d1e03-9a97-4a58-92b0-e9d83b9e5052 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:08.214963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d1e03-9a97-4a58-92b0-e9d83b9e5052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:08.236548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e89d1e03-9a97-4a58-92b0-e9d83b9e5052 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:08.237765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e89d1e03-9a97-4a58-92b0-e9d83b9e5052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:08.256007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:08.302434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1102/2184] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:08.312844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158f69-5885-4ee9-b790-eeb6a03ac6b7 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:08.313352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158f69-5885-4ee9-b790-eeb6a03ac6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:08.313446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158f69-5885-4ee9-b790-eeb6a03ac6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:08.321030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:08.334977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-91158f69-5885-4ee9-b790-eeb6a03ac6b7 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:08.336256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-91158f69-5885-4ee9-b790-eeb6a03ac6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:08.344552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1083/2185] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:08.348685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d1e03-9a97-4a58-92b0-e9d83b9e5052 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:08.359559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d1e03-9a97-4a58-92b0-e9d83b9e5052 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:08.364680 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75affc2a-e591-4a33-b4ed-e8e49f112bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:08.365490 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75affc2a-e591-4a33-b4ed-e8e49f112bdb admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:08.366014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75affc2a-e591-4a33-b4ed-e8e49f112bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:08.366383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75affc2a-e591-4a33-b4ed-e8e49f112bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:08.367100 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75affc2a-e591-4a33-b4ed-e8e49f112bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:20:08.367410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75affc2a-e591-4a33-b4ed-e8e49f112bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:08.369037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75affc2a-e591-4a33-b4ed-e8e49f112bdb admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:08.382577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1103/2186] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:20:08.386718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158f69-5885-4ee9-b790-eeb6a03ac6b7 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:08.398449 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158f69-5885-4ee9-b790-eeb6a03ac6b7 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:08.403899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929c63c-cd2d-4865-b1dc-b6466bd60461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:08.404625 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929c63c-cd2d-4865-b1dc-b6466bd60461 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:08.404905 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929c63c-cd2d-4865-b1dc-b6466bd60461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:08.405176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929c63c-cd2d-4865-b1dc-b6466bd60461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:08.405822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929c63c-cd2d-4865-b1dc-b6466bd60461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:08.407877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929c63c-cd2d-4865-b1dc-b6466bd60461 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:08.537456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1084/2187] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:20:08 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:20:08.537580 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75affc2a-e591-4a33-b4ed-e8e49f112bdb admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:08.550089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75affc2a-e591-4a33-b4ed-e8e49f112bdb admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:08.671946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475f11-97d8-4361-861e-7d29b4014f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:08.672632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475f11-97d8-4361-861e-7d29b4014f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:08.672920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475f11-97d8-4361-861e-7d29b4014f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:08.673385 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475f11-97d8-4361-861e-7d29b4014f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:08.673891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14475f11-97d8-4361-861e-7d29b4014f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:08.675892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14475f11-97d8-4361-861e-7d29b4014f5e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:08.780196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1104/2188] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:20:08 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:20:08.784416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929c63c-cd2d-4865-b1dc-b6466bd60461 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:08.798201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929c63c-cd2d-4865-b1dc-b6466bd60461 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:08.812395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a6aed-593d-424a-b4c3-9d046d33a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:08.813328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a6aed-593d-424a-b4c3-9d046d33a769 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:08.813610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a6aed-593d-424a-b4c3-9d046d33a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:08.813886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a6aed-593d-424a-b4c3-9d046d33a769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:08.814565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a6aed-593d-424a-b4c3-9d046d33a769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:08.816453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a6aed-593d-424a-b4c3-9d046d33a769 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:08.830632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1085/2189] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:20:08.832089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475f11-97d8-4361-861e-7d29b4014f5e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:08.842974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475f11-97d8-4361-861e-7d29b4014f5e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:08.847681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca252e-3ecf-4f14-aa2c-5945c7fdbb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:08.848393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca252e-3ecf-4f14-aa2c-5945c7fdbb27 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:08.848577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca252e-3ecf-4f14-aa2c-5945c7fdbb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:08.848851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca252e-3ecf-4f14-aa2c-5945c7fdbb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:08.849613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca252e-3ecf-4f14-aa2c-5945c7fdbb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:08.851933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca252e-3ecf-4f14-aa2c-5945c7fdbb27 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:08.866354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1105/2190] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:20:08.867845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a6aed-593d-424a-b4c3-9d046d33a769 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:08.879569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a6aed-593d-424a-b4c3-9d046d33a769 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:08.885745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074f7c-ca3f-4710-9d75-9d823fda0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:08.886413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074f7c-ca3f-4710-9d75-9d823fda0e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:08.886690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074f7c-ca3f-4710-9d75-9d823fda0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:08.886963 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074f7c-ca3f-4710-9d75-9d823fda0e89 admin admin] PATH_INFO: `/v3/projects/d056389d57f84cb490befe4de1f9b067/users/154bb32329e3414aa19b681a23af735c/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:08.901750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1074f7c-ca3f-4710-9d75-9d823fda0e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d056389d57f84cb490befe4de1f9b067, user_id=154bb32329e3414aa19b681a23af735c, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:08.904417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1074f7c-ca3f-4710-9d75-9d823fda0e89 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:09.003301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1086/2191] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:20:08 2022] PUT /identity/v3/projects/d056389d57f84cb490befe4de1f9b067/users/154bb32329e3414aa19b681a23af735c/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:09.008882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27135ca1-0a52-472a-867e-38f306051aa5 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:09.009416 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27135ca1-0a52-472a-867e-38f306051aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:09.009865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27135ca1-0a52-472a-867e-38f306051aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:09.042291 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-27135ca1-0a52-472a-867e-38f306051aa5 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:09.044535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-27135ca1-0a52-472a-867e-38f306051aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:09.108708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1106/2192] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:20:09.119111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074f7c-ca3f-4710-9d75-9d823fda0e89 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:09.120845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c1074f7c-ca3f-4710-9d75-9d823fda0e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:09.184908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074f7c-ca3f-4710-9d75-9d823fda0e89 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:09.190431 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa1b4b-3e68-473b-a189-9db91f1964f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:09.191261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa1b4b-3e68-473b-a189-9db91f1964f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:09.191557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa1b4b-3e68-473b-a189-9db91f1964f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:09.191860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa1b4b-3e68-473b-a189-9db91f1964f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:09.204340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa1b4b-3e68-473b-a189-9db91f1964f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:09.206352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa1b4b-3e68-473b-a189-9db91f1964f6 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:09.216603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1087/2193] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:20:13.988200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9277-82da-462d-8a60-8d1f932cc6f4 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:13.992529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9277-82da-462d-8a60-8d1f932cc6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:13.992529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9277-82da-462d-8a60-8d1f932cc6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:14.009310 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-fe8e9277-82da-462d-8a60-8d1f932cc6f4 None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:14.010551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fe8e9277-82da-462d-8a60-8d1f932cc6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:14.038762 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:14.077097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1107/2194] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:20:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:14.137314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa1b4b-3e68-473b-a189-9db91f1964f6 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:14.139088 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-63aa1b4b-3e68-473b-a189-9db91f1964f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:14.225327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa1b4b-3e68-473b-a189-9db91f1964f6 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:14.232111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c568e0-5424-4628-a000-faaa13c88fb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:14.232111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c568e0-5424-4628-a000-faaa13c88fb9 service swift] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:14.232111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c568e0-5424-4628-a000-faaa13c88fb9 service swift] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:14.232111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c568e0-5424-4628-a000-faaa13c88fb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:14.242006 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c568e0-5424-4628-a000-faaa13c88fb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:14.244001 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c568e0-5424-4628-a000-faaa13c88fb9 service swift] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:14.260458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1088/2195] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:20:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:20:17.124387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497db73-729f-4a93-9031-8d0c62793ff3 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:17.125404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497db73-729f-4a93-9031-8d0c62793ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:17.125404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497db73-729f-4a93-9031-8d0c62793ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:17.169614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-a497db73-729f-4a93-9031-8d0c62793ff3 None None] MFA Rules not processed for user `154bb32329e3414aa19b681a23af735c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:17.171711 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a497db73-729f-4a93-9031-8d0c62793ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:17.269850 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1108/2196] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:17.270695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c568e0-5424-4628-a000-faaa13c88fb9 service swift] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:17.299503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c568e0-5424-4628-a000-faaa13c88fb9 service swift] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:17.314200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82afe78-40b7-42aa-8f83-87ef13d20b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:17.314985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82afe78-40b7-42aa-8f83-87ef13d20b92 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:17.315420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82afe78-40b7-42aa-8f83-87ef13d20b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:17.315721 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82afe78-40b7-42aa-8f83-87ef13d20b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:17.316794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82afe78-40b7-42aa-8f83-87ef13d20b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:17.320242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82afe78-40b7-42aa-8f83-87ef13d20b92 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:17.462130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497db73-729f-4a93-9031-8d0c62793ff3 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:17.464436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1089/2197] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:20:17 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:20:17.482664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497db73-729f-4a93-9031-8d0c62793ff3 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:17.558102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c74f9-824d-413d-b64b-fa8efdebad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:17.558735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c74f9-824d-413d-b64b-fa8efdebad4a admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:17.559023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c74f9-824d-413d-b64b-fa8efdebad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:17.559302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c74f9-824d-413d-b64b-fa8efdebad4a admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:17.560000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c74f9-824d-413d-b64b-fa8efdebad4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:17.561947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c74f9-824d-413d-b64b-fa8efdebad4a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:17.680192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1109/2198] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:20:17 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:20:17.681352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82afe78-40b7-42aa-8f83-87ef13d20b92 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:17.697935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82afe78-40b7-42aa-8f83-87ef13d20b92 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:17.711404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2dc46-fac3-4896-9cbd-157d9cea3be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:17.712188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2dc46-fac3-4896-9cbd-157d9cea3be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:17.712542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2dc46-fac3-4896-9cbd-157d9cea3be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:17.712888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2dc46-fac3-4896-9cbd-157d9cea3be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:17.713843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2dc46-fac3-4896-9cbd-157d9cea3be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:17.716046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2dc46-fac3-4896-9cbd-157d9cea3be9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:17.725708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:17.744858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1090/2199] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:20:17.749365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c74f9-824d-413d-b64b-fa8efdebad4a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:17.761854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c74f9-824d-413d-b64b-fa8efdebad4a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:17.792887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60242255-d029-4365-af35-a79ae4352f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:17.793579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60242255-d029-4365-af35-a79ae4352f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:17.793865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60242255-d029-4365-af35-a79ae4352f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:17.794144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60242255-d029-4365-af35-a79ae4352f71 admin admin] PATH_INFO: `/v3/projects/ca360b8865404e2199c3c78504381c32/users/c041d33eac8a4abbac21b972ecc017ee/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:17.830495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60242255-d029-4365-af35-a79ae4352f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca360b8865404e2199c3c78504381c32, user_id=c041d33eac8a4abbac21b972ecc017ee, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:17.834449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60242255-d029-4365-af35-a79ae4352f71 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:17.915320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1110/2200] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:20:17 2022] PUT /identity/v3/projects/ca360b8865404e2199c3c78504381c32/users/c041d33eac8a4abbac21b972ecc017ee/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:17.916622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2dc46-fac3-4896-9cbd-157d9cea3be9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:17.946976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2dc46-fac3-4896-9cbd-157d9cea3be9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:18.024647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36875c-527a-4554-88e5-6f3b8282b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:18.025560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36875c-527a-4554-88e5-6f3b8282b028 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:18.026337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36875c-527a-4554-88e5-6f3b8282b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:18.026787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36875c-527a-4554-88e5-6f3b8282b028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:18.027995 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36875c-527a-4554-88e5-6f3b8282b028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:18.029866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36875c-527a-4554-88e5-6f3b8282b028 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:18.046327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1091/2201] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:20:18.048389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60242255-d029-4365-af35-a79ae4352f71 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:18.060384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60242255-d029-4365-af35-a79ae4352f71 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:18.069234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b6137-9671-4b5a-9e27-10dbaff35d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:18.069744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b6137-9671-4b5a-9e27-10dbaff35d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:18.070050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b6137-9671-4b5a-9e27-10dbaff35d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:18.070316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b6137-9671-4b5a-9e27-10dbaff35d39 admin admin] PATH_INFO: `/v3/projects/ca360b8865404e2199c3c78504381c32/users/c041d33eac8a4abbac21b972ecc017ee/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:18.073667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b6137-9671-4b5a-9e27-10dbaff35d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca360b8865404e2199c3c78504381c32, user_id=c041d33eac8a4abbac21b972ecc017ee, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:18.075893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b6137-9671-4b5a-9e27-10dbaff35d39 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:18.094907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1111/2202] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:20:18 2022] PUT /identity/v3/projects/ca360b8865404e2199c3c78504381c32/users/c041d33eac8a4abbac21b972ecc017ee/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:21.766204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36875c-527a-4554-88e5-6f3b8282b028 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:21.768617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8a36875c-527a-4554-88e5-6f3b8282b028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:21.784131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36875c-527a-4554-88e5-6f3b8282b028 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:21.900091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:21.901271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:21.902140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:21.902661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] PATH_INFO: `/v3/users/d7488acd4079403398b0f0c2e22905f3` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:21.904437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7488acd4079403398b0f0c2e22905f3)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:21.906862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:22.106629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7488acd4079403398b0f0c2e22905f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:22.194775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7488acd4079403398b0f0c2e22905f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:22.225522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7488acd4079403398b0f0c2e22905f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:22.226498 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7488acd4079403398b0f0c2e22905f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:22.243601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7488acd4079403398b0f0c2e22905f3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:22.257246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1092/2203] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:20:21 2022] DELETE /identity/v3/users/d7488acd4079403398b0f0c2e22905f3 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:22.262434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e5404-a0b2-4a14-8743-07520b19cc9d None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:22.263854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e5404-a0b2-4a14-8743-07520b19cc9d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:22.264598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e5404-a0b2-4a14-8743-07520b19cc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:22.304400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5b1e5404-a0b2-4a14-8743-07520b19cc9d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:22.305815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5b1e5404-a0b2-4a14-8743-07520b19cc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:22.335052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:22.430487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1112/2204] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:22.447506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:22.449998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:22.485515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:22.618937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2677082-b794-445b-9311-0b6ebf78a432 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:22.628031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c802b6-7873-4c80-b312-12322af79c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:22.628675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c802b6-7873-4c80-b312-12322af79c26 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:22.628958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c802b6-7873-4c80-b312-12322af79c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:22.629233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c802b6-7873-4c80-b312-12322af79c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:22.654048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c802b6-7873-4c80-b312-12322af79c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:22.655544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c802b6-7873-4c80-b312-12322af79c26 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:22.681516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1093/2205] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:20:24.202591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e5404-a0b2-4a14-8743-07520b19cc9d None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:24.202591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5b1e5404-a0b2-4a14-8743-07520b19cc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:24.216577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e5404-a0b2-4a14-8743-07520b19cc9d None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:24.233253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:24.237493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:24.237493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:24.237493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] PATH_INFO: `/v3/projects/5df2a1a2d0634e9797575c18665352f3` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:24.237493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df2a1a2d0634e9797575c18665352f3)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:24.238656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:24.429692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df2a1a2d0634e9797575c18665352f3', 'request_id': 'req-c79100fc-7223-4fa8-9304-4eb5d1bc973e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:24.593289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df2a1a2d0634e9797575c18665352f3', 'request_id': 'req-c79100fc-7223-4fa8-9304-4eb5d1bc973e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:24.602593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df2a1a2d0634e9797575c18665352f3', 'request_id': 'req-c79100fc-7223-4fa8-9304-4eb5d1bc973e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:24.626919 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] The token cache is being invalidate because project 5df2a1a2d0634e9797575c18665352f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:20:24.627249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:24.627908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c79100fc-7223-4fa8-9304-4eb5d1bc973e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:24.629642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1113/2206] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:20:24 2022] DELETE /identity/v3/projects/5df2a1a2d0634e9797575c18665352f3 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:24.634932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec9618-2290-4330-87bf-862ec6e8d022 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:24.636082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec9618-2290-4330-87bf-862ec6e8d022 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:24.636584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec9618-2290-4330-87bf-862ec6e8d022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:24.684831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-4eec9618-2290-4330-87bf-862ec6e8d022 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:24.684831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4eec9618-2290-4330-87bf-862ec6e8d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:24.853720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1094/2207] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:24.861855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7a430-2db5-4d64-b134-fe6a05374427 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:24.862426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7a430-2db5-4d64-b134-fe6a05374427 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:24.863578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7a430-2db5-4d64-b134-fe6a05374427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:24.896869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f9f7a430-2db5-4d64-b134-fe6a05374427 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:24.902920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f9f7a430-2db5-4d64-b134-fe6a05374427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:24.915534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1114/2208] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:24.919199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec9618-2290-4330-87bf-862ec6e8d022 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:24.950629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec9618-2290-4330-87bf-862ec6e8d022 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:24.968285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50b702-f967-4c16-92d9-4d957f08bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:24.975109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50b702-f967-4c16-92d9-4d957f08bb6b admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:24.975109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50b702-f967-4c16-92d9-4d957f08bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:24.975109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50b702-f967-4c16-92d9-4d957f08bb6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:24.975109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50b702-f967-4c16-92d9-4d957f08bb6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:20:24.975109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50b702-f967-4c16-92d9-4d957f08bb6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:24.980090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50b702-f967-4c16-92d9-4d957f08bb6b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:25.011559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1095/2209] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:20:25.015742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7a430-2db5-4d64-b134-fe6a05374427 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:25.028625 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7a430-2db5-4d64-b134-fe6a05374427 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:25.044081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4e059-0a51-4661-9d77-ad462703f03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:25.045109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4e059-0a51-4661-9d77-ad462703f03d admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:25.045739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4e059-0a51-4661-9d77-ad462703f03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:25.046244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4e059-0a51-4661-9d77-ad462703f03d admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:25.047121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4e059-0a51-4661-9d77-ad462703f03d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:25.049422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4e059-0a51-4661-9d77-ad462703f03d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:25.221096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1115/2210] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:20:25 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:20:25.226183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50b702-f967-4c16-92d9-4d957f08bb6b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:25.248267 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50b702-f967-4c16-92d9-4d957f08bb6b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:25.407897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c47956-ca67-4bc6-9749-1f08d337433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:25.408619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c47956-ca67-4bc6-9749-1f08d337433d admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:25.408860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c47956-ca67-4bc6-9749-1f08d337433d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:25.409133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c47956-ca67-4bc6-9749-1f08d337433d admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:25.409781 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c47956-ca67-4bc6-9749-1f08d337433d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:25.413738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c47956-ca67-4bc6-9749-1f08d337433d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:25.540587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1096/2211] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:20:25 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:20:25.543256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4e059-0a51-4661-9d77-ad462703f03d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:25.562632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4e059-0a51-4661-9d77-ad462703f03d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:25.575825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33b31a-c54d-4d24-bf6e-5ca88ce71df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:25.576614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33b31a-c54d-4d24-bf6e-5ca88ce71df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:25.576961 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33b31a-c54d-4d24-bf6e-5ca88ce71df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:25.577249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33b31a-c54d-4d24-bf6e-5ca88ce71df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:25.578071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33b31a-c54d-4d24-bf6e-5ca88ce71df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:25.579703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33b31a-c54d-4d24-bf6e-5ca88ce71df5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:25.604266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1116/2212] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:20:25.608848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c47956-ca67-4bc6-9749-1f08d337433d admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:25.628858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c47956-ca67-4bc6-9749-1f08d337433d admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:25.648808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1f694-5f26-40f1-95b4-c1d452700681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:25.650459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f694-5f26-40f1-95b4-c1d452700681 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:25.650908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f694-5f26-40f1-95b4-c1d452700681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:25.651347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f694-5f26-40f1-95b4-c1d452700681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:25.652265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1f694-5f26-40f1-95b4-c1d452700681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:25.654079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1f694-5f26-40f1-95b4-c1d452700681 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:25.680842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1097/2213] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:20:25.685079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33b31a-c54d-4d24-bf6e-5ca88ce71df5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:25.703181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33b31a-c54d-4d24-bf6e-5ca88ce71df5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:25.720939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69563d92-6075-4281-b07f-9166988d63c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:25.721944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69563d92-6075-4281-b07f-9166988d63c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:25.722399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69563d92-6075-4281-b07f-9166988d63c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:25.722841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69563d92-6075-4281-b07f-9166988d63c5 admin admin] PATH_INFO: `/v3/projects/feb9c4f260af434c9f70eaeb03f69eba/users/0e2f894e9b674aa09dda2400d810b6be/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:25.762479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69563d92-6075-4281-b07f-9166988d63c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb9c4f260af434c9f70eaeb03f69eba, user_id=0e2f894e9b674aa09dda2400d810b6be, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:25.765514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69563d92-6075-4281-b07f-9166988d63c5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:25.909121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1117/2214] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:20:25 2022] PUT /identity/v3/projects/feb9c4f260af434c9f70eaeb03f69eba/users/0e2f894e9b674aa09dda2400d810b6be/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:25.911257 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba145bf-05ac-4083-b84d-f58feb6f8503 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:25.911549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba145bf-05ac-4083-b84d-f58feb6f8503 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:25.912387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba145bf-05ac-4083-b84d-f58feb6f8503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:25.966797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-9ba145bf-05ac-4083-b84d-f58feb6f8503 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:25.968376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9ba145bf-05ac-4083-b84d-f58feb6f8503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:26.009313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:26.133542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1098/2215] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:26.142351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69563d92-6075-4281-b07f-9166988d63c5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:26.146741 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-69563d92-6075-4281-b07f-9166988d63c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:26.247479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:26.282137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69563d92-6075-4281-b07f-9166988d63c5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:26.287478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b7939-8b54-4939-bfbd-f067efc95bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:26.294579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b7939-8b54-4939-bfbd-f067efc95bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:26.294579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b7939-8b54-4939-bfbd-f067efc95bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:26.294579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b7939-8b54-4939-bfbd-f067efc95bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:26.301015 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b7939-8b54-4939-bfbd-f067efc95bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:26.303038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b7939-8b54-4939-bfbd-f067efc95bd3 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:26.331719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1118/2216] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:20:27.967475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064bce8-72c9-4435-b50d-effad163c3fd None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:27.968036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064bce8-72c9-4435-b50d-effad163c3fd None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:27.968156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064bce8-72c9-4435-b50d-effad163c3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:28.039879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6064bce8-72c9-4435-b50d-effad163c3fd None None] MFA Rules not processed for user `c041d33eac8a4abbac21b972ecc017ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:28.041541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6064bce8-72c9-4435-b50d-effad163c3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:28.180145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c2fdb-fefe-45ea-9713-a65f0991581b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:28.180776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c2fdb-fefe-45ea-9713-a65f0991581b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:28.180776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c2fdb-fefe-45ea-9713-a65f0991581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:28.217908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1099/2217] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:28.234775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064bce8-72c9-4435-b50d-effad163c3fd None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:28.236866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6064bce8-72c9-4435-b50d-effad163c3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:28.270595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3f5c2fdb-fefe-45ea-9713-a65f0991581b None None] MFA Rules not processed for user `0e2f894e9b674aa09dda2400d810b6be`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:28.273056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3f5c2fdb-fefe-45ea-9713-a65f0991581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:28.380684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064bce8-72c9-4435-b50d-effad163c3fd None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:28.388710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef30f3b-db9c-4966-a66f-354681bd7118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:28.389344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30f3b-db9c-4966-a66f-354681bd7118 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:28.389684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30f3b-db9c-4966-a66f-354681bd7118 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:28.389962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30f3b-db9c-4966-a66f-354681bd7118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:28.392938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8ef30f3b-db9c-4966-a66f-354681bd7118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:28.408703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1119/2218] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:28.422609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c2fdb-fefe-45ea-9713-a65f0991581b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:28.430904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3f5c2fdb-fefe-45ea-9713-a65f0991581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:28.468552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:28.524299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef30f3b-db9c-4966-a66f-354681bd7118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:28.529631 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef30f3b-db9c-4966-a66f-354681bd7118 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:28.556734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1100/2219] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:20:28.579899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c2fdb-fefe-45ea-9713-a65f0991581b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:28.592538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e376524-1918-42a7-9907-99e4861f8021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:28.593271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e376524-1918-42a7-9907-99e4861f8021 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:28.593740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e376524-1918-42a7-9907-99e4861f8021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:28.593949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e376524-1918-42a7-9907-99e4861f8021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:28.607301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e376524-1918-42a7-9907-99e4861f8021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:28.609639 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e376524-1918-42a7-9907-99e4861f8021 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:28.627767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1120/2220] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:20:30.946035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084c837-c2aa-4149-a5b3-5a879ae91125 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:30.946675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084c837-c2aa-4149-a5b3-5a879ae91125 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:30.946675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084c837-c2aa-4149-a5b3-5a879ae91125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:30.970212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-1084c837-c2aa-4149-a5b3-5a879ae91125 None None] MFA Rules not processed for user `0e2f894e9b674aa09dda2400d810b6be`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:30.971728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-1084c837-c2aa-4149-a5b3-5a879ae91125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:30.992717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1101/2221] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:32.558390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a7bd-6e61-4d4a-9417-ccc753e39bbb None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:32.558996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a7bd-6e61-4d4a-9417-ccc753e39bbb None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:32.558996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a7bd-6e61-4d4a-9417-ccc753e39bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:32.582455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5ee8a7bd-6e61-4d4a-9417-ccc753e39bbb None None] MFA Rules not processed for user `154bb32329e3414aa19b681a23af735c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:32.584234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5ee8a7bd-6e61-4d4a-9417-ccc753e39bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:32.592463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1121/2222] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:40.963499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=10 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:41.366761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42976d4-185e-4d92-942a-2c66cde9aa4a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:41.367049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42976d4-185e-4d92-942a-2c66cde9aa4a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:41.367334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42976d4-185e-4d92-942a-2c66cde9aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:41.390023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a42976d4-185e-4d92-942a-2c66cde9aa4a None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:41.391234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a42976d4-185e-4d92-942a-2c66cde9aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:41.450778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1102/2223] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 12:20:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:41.464508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a7bd-6e61-4d4a-9417-ccc753e39bbb None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:41.466124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5ee8a7bd-6e61-4d4a-9417-ccc753e39bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:41.537800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a7bd-6e61-4d4a-9417-ccc753e39bbb None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:41.543032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9300dcb-af4d-4847-805f-58f7c350ab20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:41.543685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9300dcb-af4d-4847-805f-58f7c350ab20 service swift] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:41.543970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9300dcb-af4d-4847-805f-58f7c350ab20 service swift] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:41.544246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9300dcb-af4d-4847-805f-58f7c350ab20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:41.549548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:41.553426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9300dcb-af4d-4847-805f-58f7c350ab20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:41.555002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9300dcb-af4d-4847-805f-58f7c350ab20 service swift] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:41.563308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1122/2224] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:20:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 12:20:45.068970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42976d4-185e-4d92-942a-2c66cde9aa4a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:45.071110 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a42976d4-185e-4d92-942a-2c66cde9aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:45.089506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42976d4-185e-4d92-942a-2c66cde9aa4a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:45.094218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:45.094856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:45.102333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:45.102333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] PATH_INFO: `/v3/users/0660de8e84894260b053754e90725562` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:45.102333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0660de8e84894260b053754e90725562)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:45.102333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:45.312934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0660de8e84894260b053754e90725562'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.388997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0660de8e84894260b053754e90725562'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.402199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0660de8e84894260b053754e90725562'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.402888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0660de8e84894260b053754e90725562'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.409989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-325b282e-1cba-43e2-89bb-cfa985ff2ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0660de8e84894260b053754e90725562'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.416590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1103/2225] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:20:45 2022] DELETE /identity/v3/users/0660de8e84894260b053754e90725562 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:45.631076 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9300dcb-af4d-4847-805f-58f7c350ab20 service swift] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:45.647008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9300dcb-af4d-4847-805f-58f7c350ab20 service swift] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:45.710943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:45.711799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:45.712070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:45.712344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] PATH_INFO: `/v3/projects/b3e2cad3a76648ca878cc4c90ce3fc8b` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:45.713550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e2cad3a76648ca878cc4c90ce3fc8b)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:45.715477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:45.904467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e2cad3a76648ca878cc4c90ce3fc8b', 'request_id': 'req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.964094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e2cad3a76648ca878cc4c90ce3fc8b', 'request_id': 'req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.972289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e2cad3a76648ca878cc4c90ce3fc8b', 'request_id': 'req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.986733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] The token cache is being invalidate because project b3e2cad3a76648ca878cc4c90ce3fc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:20:45.987053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.987918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ecfc94f2-9700-4030-b3e6-26de20aa1bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:45.990294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1123/2226] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:20:45 2022] DELETE /identity/v3/projects/b3e2cad3a76648ca878cc4c90ce3fc8b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:45.995409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564cfd-57f3-4530-b8a2-032eb7f07e9f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:45.995726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564cfd-57f3-4530-b8a2-032eb7f07e9f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:45.997797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564cfd-57f3-4530-b8a2-032eb7f07e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.016877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-50564cfd-57f3-4530-b8a2-032eb7f07e9f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:46.018171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-50564cfd-57f3-4530-b8a2-032eb7f07e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:46.089901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1104/2227] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:46.097833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3d3f5-3db4-4254-a154-809cf4881c54 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:46.098494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3d3f5-3db4-4254-a154-809cf4881c54 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:46.098773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3d3f5-3db4-4254-a154-809cf4881c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.123860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-56b3d3f5-3db4-4254-a154-809cf4881c54 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:46.125298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-56b3d3f5-3db4-4254-a154-809cf4881c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:46.134761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1124/2228] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:20:46.138850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50564cfd-57f3-4530-b8a2-032eb7f07e9f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:46.149541 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50564cfd-57f3-4530-b8a2-032eb7f07e9f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:46.154381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7577-fb33-4915-a5a6-46691c572c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:46.155055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7577-fb33-4915-a5a6-46691c572c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:46.155281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7577-fb33-4915-a5a6-46691c572c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:46.155555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7577-fb33-4915-a5a6-46691c572c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.156412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c7577-fb33-4915-a5a6-46691c572c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:20:46.156726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c7577-fb33-4915-a5a6-46691c572c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:46.159151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c7577-fb33-4915-a5a6-46691c572c1c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:46.178399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1105/2229] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:20:46.179717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3d3f5-3db4-4254-a154-809cf4881c54 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:46.190361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3d3f5-3db4-4254-a154-809cf4881c54 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:46.195845 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb8c21-ae93-437d-8691-aa4632ac6185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:46.196476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb8c21-ae93-437d-8691-aa4632ac6185 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:46.196773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb8c21-ae93-437d-8691-aa4632ac6185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:46.197116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb8c21-ae93-437d-8691-aa4632ac6185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.197873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb8c21-ae93-437d-8691-aa4632ac6185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:46.200066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb8c21-ae93-437d-8691-aa4632ac6185 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:46.299729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1125/2230] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:20:46 2022] POST /identity/v3/projects => generated 397 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:20:46.304518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7577-fb33-4915-a5a6-46691c572c1c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:46.311286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:46.314775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7577-fb33-4915-a5a6-46691c572c1c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:46.389672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2900b-9940-4c04-8722-8bbb99c9de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:46.390282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2900b-9940-4c04-8722-8bbb99c9de9d admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:46.390561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2900b-9940-4c04-8722-8bbb99c9de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:46.390835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2900b-9940-4c04-8722-8bbb99c9de9d admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.391463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2900b-9940-4c04-8722-8bbb99c9de9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:46.393602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2900b-9940-4c04-8722-8bbb99c9de9d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:46.501001 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1106/2231] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:20:46 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:20:46.512585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb8c21-ae93-437d-8691-aa4632ac6185 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:46.526584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb8c21-ae93-437d-8691-aa4632ac6185 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:46.532466 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801a780-7296-44f9-a0da-d2b3dd828529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:46.533115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801a780-7296-44f9-a0da-d2b3dd828529 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:46.533643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801a780-7296-44f9-a0da-d2b3dd828529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:46.533988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801a780-7296-44f9-a0da-d2b3dd828529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.534702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801a780-7296-44f9-a0da-d2b3dd828529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:46.536484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801a780-7296-44f9-a0da-d2b3dd828529 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:46.547560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1126/2232] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:20:46.551371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2900b-9940-4c04-8722-8bbb99c9de9d admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:46.563786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2900b-9940-4c04-8722-8bbb99c9de9d admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:46.568773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550bbdc-56a1-4f33-98e4-cf5b6c60d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:46.569401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550bbdc-56a1-4f33-98e4-cf5b6c60d331 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:46.569718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550bbdc-56a1-4f33-98e4-cf5b6c60d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:46.569996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550bbdc-56a1-4f33-98e4-cf5b6c60d331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.571195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550bbdc-56a1-4f33-98e4-cf5b6c60d331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:46.572834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550bbdc-56a1-4f33-98e4-cf5b6c60d331 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:46.587403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1107/2233] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:20:46.588581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801a780-7296-44f9-a0da-d2b3dd828529 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:46.598546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801a780-7296-44f9-a0da-d2b3dd828529 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:46.603215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e33ba3-154c-4f2a-9418-1b36bf5a9266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:46.603911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e33ba3-154c-4f2a-9418-1b36bf5a9266 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:46.604197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e33ba3-154c-4f2a-9418-1b36bf5a9266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:46.604476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e33ba3-154c-4f2a-9418-1b36bf5a9266 admin admin] PATH_INFO: `/v3/projects/456a4266e5fd4d65b94eae37354d9e23/users/bcf8d8048b174953a097710d43a57007/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.621106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e33ba3-154c-4f2a-9418-1b36bf5a9266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=456a4266e5fd4d65b94eae37354d9e23, user_id=bcf8d8048b174953a097710d43a57007, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:46.623894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e33ba3-154c-4f2a-9418-1b36bf5a9266 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:46.703290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1127/2234] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:20:46 2022] PUT /identity/v3/projects/456a4266e5fd4d65b94eae37354d9e23/users/bcf8d8048b174953a097710d43a57007/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:46.714283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1561-9d09-432c-8330-9b47f67c44b7 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:46.714660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1561-9d09-432c-8330-9b47f67c44b7 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:46.715173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1561-9d09-432c-8330-9b47f67c44b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.748695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-5a6e1561-9d09-432c-8330-9b47f67c44b7 None None] MFA Rules not processed for user `bcf8d8048b174953a097710d43a57007`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:46.750043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5a6e1561-9d09-432c-8330-9b47f67c44b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:46.818283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1108/2235] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:46.829770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e33ba3-154c-4f2a-9418-1b36bf5a9266 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:46.831772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-80e33ba3-154c-4f2a-9418-1b36bf5a9266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:46.863024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:46.903758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e33ba3-154c-4f2a-9418-1b36bf5a9266 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:46.907960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46963-8622-42a1-8918-2639dcaf0353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:46.908579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46963-8622-42a1-8918-2639dcaf0353 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:46.908859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46963-8622-42a1-8918-2639dcaf0353 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:46.909126 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46963-8622-42a1-8918-2639dcaf0353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:46.920227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee46963-8622-42a1-8918-2639dcaf0353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:46.920227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee46963-8622-42a1-8918-2639dcaf0353 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:46.929752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1128/2236] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:20:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:20:50.684065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9864-cce5-4ade-9964-ca848597ae57 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:50.684065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9864-cce5-4ade-9964-ca848597ae57 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:50.684065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9864-cce5-4ade-9964-ca848597ae57 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:50.684065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1109/2237] 10.222.0.27 () {54 vars in 961 bytes} [Fri Sep 9 12:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:20:50.684981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559f83b-a31d-444c-9903-4d305f63e0a0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:50.684981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559f83b-a31d-444c-9903-4d305f63e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:50.684981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559f83b-a31d-444c-9903-4d305f63e0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:50.706599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d559f83b-a31d-444c-9903-4d305f63e0a0 None None] MFA Rules not processed for user `03a4b508dd7048df83f7beeacfe9c085`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:50.707905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d559f83b-a31d-444c-9903-4d305f63e0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:50.800030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1129/2238] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Sep 9 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:50.808130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed9864-cce5-4ade-9964-ca848597ae57 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:50.821925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed9864-cce5-4ade-9964-ca848597ae57 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:50.827050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851cb81-8891-4f55-a828-347e58770a93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:50.827720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851cb81-8891-4f55-a828-347e58770a93 service placement] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:50.828012 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851cb81-8891-4f55-a828-347e58770a93 service placement] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:50.828289 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851cb81-8891-4f55-a828-347e58770a93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:50.830080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7851cb81-8891-4f55-a828-347e58770a93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:50.843858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851cb81-8891-4f55-a828-347e58770a93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:50.845441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851cb81-8891-4f55-a828-347e58770a93 service placement] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:50.856240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1110/2239] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:20:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:20:52.904560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559f83b-a31d-444c-9903-4d305f63e0a0 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:52.981576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559f83b-a31d-444c-9903-4d305f63e0a0 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:52.986407 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:52.987043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:52.987325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:52.987685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] PATH_INFO: `/v3/users/bcf8d8048b174953a097710d43a57007` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:52.988847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf8d8048b174953a097710d43a57007)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:52.990808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:53.167275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf8d8048b174953a097710d43a57007'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:53.167965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf8d8048b174953a097710d43a57007'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:53.240939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf8d8048b174953a097710d43a57007'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:53.242182 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf8d8048b174953a097710d43a57007'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:53.248810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:53.252658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf8d8048b174953a097710d43a57007'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:53.271591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1130/2240] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:20:52 2022] DELETE /identity/v3/users/bcf8d8048b174953a097710d43a57007 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:20:53.276177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b0ce3-57e9-4a1f-9a67-bd77c946016e None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:53.276664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b0ce3-57e9-4a1f-9a67-bd77c946016e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:53.276923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b0ce3-57e9-4a1f-9a67-bd77c946016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:53.301462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-7f2b0ce3-57e9-4a1f-9a67-bd77c946016e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:20:53.303656 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7f2b0ce3-57e9-4a1f-9a67-bd77c946016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:53.367544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:53.379351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1111/2241] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:20:53.388442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:53.392934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:53.460212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700224ae-0b71-44e7-8a70-ba663768a620 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:53.464203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59e700-4d74-477b-abe0-20b042ba8d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:53.464827 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e700-4d74-477b-abe0-20b042ba8d2b service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:53.465108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e700-4d74-477b-abe0-20b042ba8d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:53.465384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e700-4d74-477b-abe0-20b042ba8d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:53.474943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59e700-4d74-477b-abe0-20b042ba8d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:53.477107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59e700-4d74-477b-abe0-20b042ba8d2b service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:53.487721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1131/2242] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:20:53.973889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b0ce3-57e9-4a1f-9a67-bd77c946016e None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:20:53.975319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7f2b0ce3-57e9-4a1f-9a67-bd77c946016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:20:53.989706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b0ce3-57e9-4a1f-9a67-bd77c946016e None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:20:53.995128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:20:53.995807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:20:53.996830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:20:53.996830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] PATH_INFO: `/v3/projects/456a4266e5fd4d65b94eae37354d9e23` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:20:53.997505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=456a4266e5fd4d65b94eae37354d9e23)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:20:53.999453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:20:54.141401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '456a4266e5fd4d65b94eae37354d9e23', 'request_id': 'req-81e5c584-c016-4624-8474-da515bf2ca2d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:54.148415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '456a4266e5fd4d65b94eae37354d9e23', 'request_id': 'req-81e5c584-c016-4624-8474-da515bf2ca2d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:54.234693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '456a4266e5fd4d65b94eae37354d9e23', 'request_id': 'req-81e5c584-c016-4624-8474-da515bf2ca2d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:54.246474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] The token cache is being invalidate because project 456a4266e5fd4d65b94eae37354d9e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:20:54.246768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:54.247730 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:20:54.249504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1112/2243] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:20:53 2022] DELETE /identity/v3/projects/456a4266e5fd4d65b94eae37354d9e23 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:21:00.063039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fceaf5-4735-4786-aba4-9d9fcc63aa20 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:00.063567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fceaf5-4735-4786-aba4-9d9fcc63aa20 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:00.063567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fceaf5-4735-4786-aba4-9d9fcc63aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:00.085699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b1fceaf5-4735-4786-aba4-9d9fcc63aa20 None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:00.087024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b1fceaf5-4735-4786-aba4-9d9fcc63aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:00.161379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1132/2244] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:00.175505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:00.177570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:00.287726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5c584-c016-4624-8474-da515bf2ca2d admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:00.298376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b1089-4dbf-4907-8aab-9f4ea840ed3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:00.299175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b1089-4dbf-4907-8aab-9f4ea840ed3b service swift] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:00.299409 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b1089-4dbf-4907-8aab-9f4ea840ed3b service swift] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:00.299850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b1089-4dbf-4907-8aab-9f4ea840ed3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:00.333628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b1089-4dbf-4907-8aab-9f4ea840ed3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:00.333628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b1089-4dbf-4907-8aab-9f4ea840ed3b service swift] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:00.333628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1113/2245] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:21:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:21:10.097259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fceaf5-4735-4786-aba4-9d9fcc63aa20 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:10.101283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b1fceaf5-4735-4786-aba4-9d9fcc63aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:10.283776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fceaf5-4735-4786-aba4-9d9fcc63aa20 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:10.283776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:10.283776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:10.283776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:10.284185 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:10.284185 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:10.317570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:10.381551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:10.455257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:10.460096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:10.506808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1133/2246] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:21:13.800761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ef67-8385-4e21-a6ca-12cfe850546b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:13.801376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ef67-8385-4e21-a6ca-12cfe850546b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:13.801538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ef67-8385-4e21-a6ca-12cfe850546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:13.831221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b336ef67-8385-4e21-a6ca-12cfe850546b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:13.832840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b336ef67-8385-4e21-a6ca-12cfe850546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:13.912440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1114/2247] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:13.939199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:13.941335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:14.048994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ed98e-0f44-4985-b069-27bd2b676139 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:14.055773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce9d0b-c4c7-47ee-a349-8ee64fd475ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:14.056491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce9d0b-c4c7-47ee-a349-8ee64fd475ad service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:14.056839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce9d0b-c4c7-47ee-a349-8ee64fd475ad service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:14.057179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce9d0b-c4c7-47ee-a349-8ee64fd475ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:14.067528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce9d0b-c4c7-47ee-a349-8ee64fd475ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:14.069232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce9d0b-c4c7-47ee-a349-8ee64fd475ad service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:14.080201 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1134/2248] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:21:19.204056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0131bb-6f31-4d62-8585-d6865e7bcfd8 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:19.204933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0131bb-6f31-4d62-8585-d6865e7bcfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:19.205212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0131bb-6f31-4d62-8585-d6865e7bcfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:19.227263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8a0131bb-6f31-4d62-8585-d6865e7bcfd8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:19.228715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8a0131bb-6f31-4d62-8585-d6865e7bcfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:19.237186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1115/2249] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:19.280237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce9d0b-c4c7-47ee-a349-8ee64fd475ad service nova] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:19.292598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce9d0b-c4c7-47ee-a349-8ee64fd475ad service nova] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:19.298111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fb501-5d92-4504-bc16-d187815bd1b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:19.298713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fb501-5d92-4504-bc16-d187815bd1b2 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:19.298989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fb501-5d92-4504-bc16-d187815bd1b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:19.299258 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fb501-5d92-4504-bc16-d187815bd1b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:19.309461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fb501-5d92-4504-bc16-d187815bd1b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:19.311001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fb501-5d92-4504-bc16-d187815bd1b2 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:19.320763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1135/2250] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:21:21.197261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493875a-a7cf-43a2-b78c-f536e23f8919 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:21.197756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493875a-a7cf-43a2-b78c-f536e23f8919 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:21.197849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493875a-a7cf-43a2-b78c-f536e23f8919 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:21.199236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1116/2251] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:21:21.205386 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b2e5-7b46-4643-ae4a-e52a2e2272c0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:21.206165 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b2e5-7b46-4643-ae4a-e52a2e2272c0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:21.206421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b2e5-7b46-4643-ae4a-e52a2e2272c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:21.228380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-cb78b2e5-7b46-4643-ae4a-e52a2e2272c0 None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:21.229585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cb78b2e5-7b46-4643-ae4a-e52a2e2272c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:21.239367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1136/2252] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:21.254035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493875a-a7cf-43a2-b78c-f536e23f8919 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:21.255910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d493875a-a7cf-43a2-b78c-f536e23f8919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:21.320535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493875a-a7cf-43a2-b78c-f536e23f8919 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:21.324402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8abbef-cf5c-420d-b09d-c9d04764132b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'decb5421872c4034bbbaa8c3cd9dcb5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:21.325017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8abbef-cf5c-420d-b09d-c9d04764132b service glance] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:21.325308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8abbef-cf5c-420d-b09d-c9d04764132b service glance] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:21.325609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8abbef-cf5c-420d-b09d-c9d04764132b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:21.336733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8abbef-cf5c-420d-b09d-c9d04764132b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:21.338168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8abbef-cf5c-420d-b09d-c9d04764132b service glance] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:21.349119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1117/2253] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:21:21.614180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fe3e1-081f-45a0-a90a-500c70fe5709 None None] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:21.614472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fe3e1-081f-45a0-a90a-500c70fe5709 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:21.614754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fe3e1-081f-45a0-a90a-500c70fe5709 None None] PATH_INFO: `/` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:21.616160 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1137/2254] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:21:21.621395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de720a2-b0c6-4fc2-89c1-9269d13ee63b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:21.621619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de720a2-b0c6-4fc2-89c1-9269d13ee63b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:21.621899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de720a2-b0c6-4fc2-89c1-9269d13ee63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:21.642047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-9de720a2-b0c6-4fc2-89c1-9269d13ee63b None None] MFA Rules not processed for user `88d492b570be4de4b6a6d85f6374ed31`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:21.643261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9de720a2-b0c6-4fc2-89c1-9269d13ee63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:21.650830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1118/2255] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:21.663220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fe3e1-081f-45a0-a90a-500c70fe5709 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:21.665468 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fa8fe3e1-081f-45a0-a90a-500c70fe5709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:21.679008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fe3e1-081f-45a0-a90a-500c70fe5709 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:21.684840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b6c17-cf80-4a77-b469-ccc2de963d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:21.684840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b6c17-cf80-4a77-b469-ccc2de963d0a service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:21.684840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b6c17-cf80-4a77-b469-ccc2de963d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:21.684840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b6c17-cf80-4a77-b469-ccc2de963d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:21.690646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b6c17-cf80-4a77-b469-ccc2de963d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:21.692118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b6c17-cf80-4a77-b469-ccc2de963d0a service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:21.699899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1138/2256] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:21:21.783587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b171fa-120e-4e8f-b889-bbbad0224061 None None] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:21.783906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b171fa-120e-4e8f-b889-bbbad0224061 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:21.784186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b171fa-120e-4e8f-b889-bbbad0224061 None None] PATH_INFO: `/` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:21.787993 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1119/2257] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 12:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 12:21:21.791415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f6b2-4db1-43b2-b35f-38957abc3c4b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:21.791742 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f6b2-4db1-43b2-b35f-38957abc3c4b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:21.792055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f6b2-4db1-43b2-b35f-38957abc3c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:21.815018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-7e64f6b2-4db1-43b2-b35f-38957abc3c4b None None] MFA Rules not processed for user `4971acb91bbf498887606c5ba5d00176`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:21.816281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7e64f6b2-4db1-43b2-b35f-38957abc3c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:21.825651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1139/2258] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:21.837014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b171fa-120e-4e8f-b889-bbbad0224061 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:21.848094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b171fa-120e-4e8f-b889-bbbad0224061 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:21.852511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ca84-5ddf-4049-86e3-f82f8e819a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:21.853099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ca84-5ddf-4049-86e3-f82f8e819a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:21.853393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ca84-5ddf-4049-86e3-f82f8e819a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:21.853644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ca84-5ddf-4049-86e3-f82f8e819a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:21.864046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60ca84-5ddf-4049-86e3-f82f8e819a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:21.865480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60ca84-5ddf-4049-86e3-f82f8e819a26 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:21.880462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1120/2259] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:21:25.009078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d7a95-d5e6-4633-97b1-0d26107a0c43 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:25.009617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d7a95-d5e6-4633-97b1-0d26107a0c43 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:25.009617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d7a95-d5e6-4633-97b1-0d26107a0c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:25.034586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e86d7a95-d5e6-4633-97b1-0d26107a0c43 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:25.035833 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e86d7a95-d5e6-4633-97b1-0d26107a0c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:25.047267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1140/2260] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:25.061363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ca84-5ddf-4049-86e3-f82f8e819a26 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:25.073836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ca84-5ddf-4049-86e3-f82f8e819a26 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:25.079560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6356cb-81c2-4f43-bb66-779df5915b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:25.080231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6356cb-81c2-4f43-bb66-779df5915b56 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:25.080856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6356cb-81c2-4f43-bb66-779df5915b56 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:25.081135 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6356cb-81c2-4f43-bb66-779df5915b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:25.091231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6356cb-81c2-4f43-bb66-779df5915b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:25.093587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6356cb-81c2-4f43-bb66-779df5915b56 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:25.109350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1121/2261] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:21:27.837739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed77a5-2eb6-46f7-8818-80d723605e34 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:27.838306 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed77a5-2eb6-46f7-8818-80d723605e34 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:27.838306 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed77a5-2eb6-46f7-8818-80d723605e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:27.860419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-16ed77a5-2eb6-46f7-8818-80d723605e34 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:27.861631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-16ed77a5-2eb6-46f7-8818-80d723605e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:27.869716 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1141/2262] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:27.891682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6356cb-81c2-4f43-bb66-779df5915b56 service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:27.904150 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6356cb-81c2-4f43-bb66-779df5915b56 service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:27.910016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec894e37-2bc6-4426-a880-e22871681f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:27.910840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec894e37-2bc6-4426-a880-e22871681f9f service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:27.911132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec894e37-2bc6-4426-a880-e22871681f9f service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:27.911569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec894e37-2bc6-4426-a880-e22871681f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:27.920381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec894e37-2bc6-4426-a880-e22871681f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:27.922016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec894e37-2bc6-4426-a880-e22871681f9f service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:27.931939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1122/2263] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:21:30.141419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9eba1-a837-452c-9e52-cb0d0a84aed2 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:30.141945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9eba1-a837-452c-9e52-cb0d0a84aed2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:30.142084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9eba1-a837-452c-9e52-cb0d0a84aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:30.160821 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-dfb9eba1-a837-452c-9e52-cb0d0a84aed2 None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:30.162070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-dfb9eba1-a837-452c-9e52-cb0d0a84aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:30.169626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1142/2264] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:30.191989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec894e37-2bc6-4426-a880-e22871681f9f service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:30.211110 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec894e37-2bc6-4426-a880-e22871681f9f service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:30.218432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c7d43-0abd-4ae5-a5be-54957929932b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:30.219053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c7d43-0abd-4ae5-a5be-54957929932b service swift] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:30.219534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c7d43-0abd-4ae5-a5be-54957929932b service swift] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:30.228582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c7d43-0abd-4ae5-a5be-54957929932b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:30.237695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c7d43-0abd-4ae5-a5be-54957929932b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:30.239264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c7d43-0abd-4ae5-a5be-54957929932b service swift] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:30.249082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1123/2265] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:21:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:21:32.172770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4195b7-0135-4190-a040-efca66eb3412 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:32.173348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4195b7-0135-4190-a040-efca66eb3412 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:32.173348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4195b7-0135-4190-a040-efca66eb3412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:32.201650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4f4195b7-0135-4190-a040-efca66eb3412 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:32.203600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4f4195b7-0135-4190-a040-efca66eb3412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:32.221504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1143/2266] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:32.240549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c7d43-0abd-4ae5-a5be-54957929932b service swift] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:32.242057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bd7c7d43-0abd-4ae5-a5be-54957929932b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:32.257917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c7d43-0abd-4ae5-a5be-54957929932b service swift] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:32.264967 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df068da3-16a7-4705-b58f-a32fc00b5a2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:32.266126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df068da3-16a7-4705-b58f-a32fc00b5a2c service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:32.266699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df068da3-16a7-4705-b58f-a32fc00b5a2c service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:32.267263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df068da3-16a7-4705-b58f-a32fc00b5a2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:32.279184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df068da3-16a7-4705-b58f-a32fc00b5a2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:32.281301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df068da3-16a7-4705-b58f-a32fc00b5a2c service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:32.293932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1124/2267] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:21:33.713323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b724-f939-4ed9-9662-ce1d6990687e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:33.713914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b724-f939-4ed9-9662-ce1d6990687e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:33.713914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342b724-f939-4ed9-9662-ce1d6990687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:33.735156 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2342b724-f939-4ed9-9662-ce1d6990687e None None] MFA Rules not processed for user `be0f76350dc148c6b51705693a1902c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:33.736420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2342b724-f939-4ed9-9662-ce1d6990687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:33.808325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:33.815087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1144/2268] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:21:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:42.287512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:46.788212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b597-afe6-406a-bcea-773b9e37f077 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:46.789369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b597-afe6-406a-bcea-773b9e37f077 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:46.789369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b597-afe6-406a-bcea-773b9e37f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:46.810275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-2654b597-afe6-406a-bcea-773b9e37f077 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:46.811766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2654b597-afe6-406a-bcea-773b9e37f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:46.820282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1125/2269] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:46.838776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342b724-f939-4ed9-9662-ce1d6990687e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:46.853672 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342b724-f939-4ed9-9662-ce1d6990687e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:46.860510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9084da6-ac5d-4ade-8990-ff9ad8c39faa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:46.866613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084da6-ac5d-4ade-8990-ff9ad8c39faa service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:46.866613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084da6-ac5d-4ade-8990-ff9ad8c39faa service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:46.866613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084da6-ac5d-4ade-8990-ff9ad8c39faa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:46.872397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9084da6-ac5d-4ade-8990-ff9ad8c39faa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:46.874216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9084da6-ac5d-4ade-8990-ff9ad8c39faa service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:46.886313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1145/2270] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:21:47.522167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30528fa-abe9-44d6-80ce-63a9464c0d01 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:47.522462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30528fa-abe9-44d6-80ce-63a9464c0d01 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:47.522732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30528fa-abe9-44d6-80ce-63a9464c0d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:47.542188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a30528fa-abe9-44d6-80ce-63a9464c0d01 None None] MFA Rules not processed for user `04c3b6e933a9414593d7552aa960967d`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:47.543383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a30528fa-abe9-44d6-80ce-63a9464c0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:47.600914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1126/2271] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:48.918886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b407af-8382-4e48-abc3-afa7b7f43a44 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:48.919380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b407af-8382-4e48-abc3-afa7b7f43a44 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:48.919526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b407af-8382-4e48-abc3-afa7b7f43a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:48.960594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e2b407af-8382-4e48-abc3-afa7b7f43a44 None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:21:48.962290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e2b407af-8382-4e48-abc3-afa7b7f43a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:21:48.973011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1146/2272] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:21:48.986820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30528fa-abe9-44d6-80ce-63a9464c0d01 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:21:48.999073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30528fa-abe9-44d6-80ce-63a9464c0d01 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:21:49.008751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cb1ba-7386-4027-8481-ff3483520fd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:21:49.008751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cb1ba-7386-4027-8481-ff3483520fd9 service swift] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:21:49.008751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cb1ba-7386-4027-8481-ff3483520fd9 service swift] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:21:49.008751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cb1ba-7386-4027-8481-ff3483520fd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:21:49.016294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cb1ba-7386-4027-8481-ff3483520fd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:21:49.018018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cb1ba-7386-4027-8481-ff3483520fd9 service swift] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:21:49.027184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1127/2273] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:21:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:21:58.941392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=9 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:59.023027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=34 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:08.744010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b92461-ccf2-46b3-8620-cf643ee0d764 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:08.744010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b92461-ccf2-46b3-8620-cf643ee0d764 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:08.744010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b92461-ccf2-46b3-8620-cf643ee0d764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:08.762810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b1b92461-ccf2-46b3-8620-cf643ee0d764 None None] MFA Rules not processed for user `0e2f894e9b674aa09dda2400d810b6be`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:22:08.768326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b1b92461-ccf2-46b3-8620-cf643ee0d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:08.819952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1147/2274] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:22:17.109194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c2650-70f8-430d-afce-f97aea875aa2 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:17.110195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c2650-70f8-430d-afce-f97aea875aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:17.110195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c2650-70f8-430d-afce-f97aea875aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:17.130817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-835c2650-70f8-430d-afce-f97aea875aa2 None None] MFA Rules not processed for user `504c97036895408b9e04deb0792d5576`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:22:17.132020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-835c2650-70f8-430d-afce-f97aea875aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:17.187494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1128/2275] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:22:18.817133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=25 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:27.180422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=25 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:28.008896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9e46-e4ba-4ad5-b417-34dfec70d68d None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:28.009347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9e46-e4ba-4ad5-b417-34dfec70d68d None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:28.009468 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9e46-e4ba-4ad5-b417-34dfec70d68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:28.028658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f59f9e46-e4ba-4ad5-b417-34dfec70d68d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:22:28.029860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f59f9e46-e4ba-4ad5-b417-34dfec70d68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:28.037675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1148/2276] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:22:28.053373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c2650-70f8-430d-afce-f97aea875aa2 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:22:28.066778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c2650-70f8-430d-afce-f97aea875aa2 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:22:28.072191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89565d-5810-45b4-bf4c-8c2097a59994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:22:28.072805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89565d-5810-45b4-bf4c-8c2097a59994 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:28.073082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89565d-5810-45b4-bf4c-8c2097a59994 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:28.073351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89565d-5810-45b4-bf4c-8c2097a59994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:28.081694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89565d-5810-45b4-bf4c-8c2097a59994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:22:28.083262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89565d-5810-45b4-bf4c-8c2097a59994 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:22:28.092629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1129/2277] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:22:31.575299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab52ea7-c915-411d-b93c-bd24b23b001a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:31.575893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab52ea7-c915-411d-b93c-bd24b23b001a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:31.575893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab52ea7-c915-411d-b93c-bd24b23b001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:31.596353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-fab52ea7-c915-411d-b93c-bd24b23b001a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:22:31.597573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fab52ea7-c915-411d-b93c-bd24b23b001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:31.606028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1149/2278] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:22:31.620504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89565d-5810-45b4-bf4c-8c2097a59994 service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:22:31.631364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89565d-5810-45b4-bf4c-8c2097a59994 service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:22:31.637536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262083-ae55-4434-93ed-224885befe97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:22:31.638133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262083-ae55-4434-93ed-224885befe97 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:31.639128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262083-ae55-4434-93ed-224885befe97 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:31.639128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262083-ae55-4434-93ed-224885befe97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:31.647338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62262083-ae55-4434-93ed-224885befe97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:22:31.649028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62262083-ae55-4434-93ed-224885befe97 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:22:31.659125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1130/2279] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:22:35.514967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1e052-ab36-4e04-8974-36e9232711d0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:35.517270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1e052-ab36-4e04-8974-36e9232711d0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:35.517270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1e052-ab36-4e04-8974-36e9232711d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:35.541450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f1f1e052-ab36-4e04-8974-36e9232711d0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:22:35.542678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f1f1e052-ab36-4e04-8974-36e9232711d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:35.551974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1150/2280] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:22:35.567516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262083-ae55-4434-93ed-224885befe97 service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:22:35.582568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262083-ae55-4434-93ed-224885befe97 service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:22:35.590053 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cb514-a8e5-48b7-8b39-ab19bbf7fce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:22:35.590672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cb514-a8e5-48b7-8b39-ab19bbf7fce4 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:35.590953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cb514-a8e5-48b7-8b39-ab19bbf7fce4 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:35.591470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cb514-a8e5-48b7-8b39-ab19bbf7fce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:35.601703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cb514-a8e5-48b7-8b39-ab19bbf7fce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:22:35.603305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cb514-a8e5-48b7-8b39-ab19bbf7fce4 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:22:35.614862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1131/2281] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:22:40.812646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533d8a-913c-4d01-be0c-d70321a5d49f None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:40.812646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533d8a-913c-4d01-be0c-d70321a5d49f None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:40.812646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533d8a-913c-4d01-be0c-d70321a5d49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:40.832061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-17533d8a-913c-4d01-be0c-d70321a5d49f None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:22:40.834258 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-17533d8a-913c-4d01-be0c-d70321a5d49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:40.842197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1151/2282] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:22:40.874696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cb514-a8e5-48b7-8b39-ab19bbf7fce4 service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:22:40.880794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cb514-a8e5-48b7-8b39-ab19bbf7fce4 service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:22:40.886595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dacfde-4449-49b3-a1a8-a84ab91bc7e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:22:40.887325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dacfde-4449-49b3-a1a8-a84ab91bc7e3 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:40.888167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dacfde-4449-49b3-a1a8-a84ab91bc7e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:40.888445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dacfde-4449-49b3-a1a8-a84ab91bc7e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:40.898046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dacfde-4449-49b3-a1a8-a84ab91bc7e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:22:40.900816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dacfde-4449-49b3-a1a8-a84ab91bc7e3 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:22:40.912952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1132/2283] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:22:48.196798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea0ded-0dd4-44d9-b79b-525956c3c78c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:48.197462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea0ded-0dd4-44d9-b79b-525956c3c78c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:48.197462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea0ded-0dd4-44d9-b79b-525956c3c78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:48.224019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-eeea0ded-0dd4-44d9-b79b-525956c3c78c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:22:48.225290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-eeea0ded-0dd4-44d9-b79b-525956c3c78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:48.233986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1152/2284] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:22:48.250551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dacfde-4449-49b3-a1a8-a84ab91bc7e3 service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:22:48.262202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dacfde-4449-49b3-a1a8-a84ab91bc7e3 service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:22:48.268392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950092-e072-4397-ae5f-7a5503c12638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:22:48.269007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950092-e072-4397-ae5f-7a5503c12638 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:48.269285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950092-e072-4397-ae5f-7a5503c12638 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:48.269556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950092-e072-4397-ae5f-7a5503c12638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:48.279382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8950092-e072-4397-ae5f-7a5503c12638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:22:48.280999 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8950092-e072-4397-ae5f-7a5503c12638 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:22:48.291958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1133/2285] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:22:50.872635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a5329-5114-4ecc-95a1-6d6d4a2f58a6 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:50.873143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a5329-5114-4ecc-95a1-6d6d4a2f58a6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:50.873261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a5329-5114-4ecc-95a1-6d6d4a2f58a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:50.880587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=16 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:50.893874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f71a5329-5114-4ecc-95a1-6d6d4a2f58a6 None None] MFA Rules not processed for user `22369962f4954442ab2b873499889d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:22:50.895103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f71a5329-5114-4ecc-95a1-6d6d4a2f58a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:50.969658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1153/2286] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:22:51.003832 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950092-e072-4397-ae5f-7a5503c12638 service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:22:51.005817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f8950092-e072-4397-ae5f-7a5503c12638 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:51.019273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950092-e072-4397-ae5f-7a5503c12638 service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:22:51.023431 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ab358-c3fb-459d-ba29-9784305ecc1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'decb5421872c4034bbbaa8c3cd9dcb5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:22:51.024298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ab358-c3fb-459d-ba29-9784305ecc1b service glance] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:51.024709 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ab358-c3fb-459d-ba29-9784305ecc1b service glance] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:51.025271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ab358-c3fb-459d-ba29-9784305ecc1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:51.027206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-762ab358-c3fb-459d-ba29-9784305ecc1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:51.042935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ab358-c3fb-459d-ba29-9784305ecc1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:22:51.044534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ab358-c3fb-459d-ba29-9784305ecc1b service glance] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:22:51.056498 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1134/2287] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:22:51.802063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a5329-5114-4ecc-95a1-6d6d4a2f58a6 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:22:51.804479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f71a5329-5114-4ecc-95a1-6d6d4a2f58a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:51.898369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a5329-5114-4ecc-95a1-6d6d4a2f58a6 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:22:51.905037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946feb-ed8f-4ac4-8a6d-96663e518d7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:22:51.905659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946feb-ed8f-4ac4-8a6d-96663e518d7d service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:22:51.905940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946feb-ed8f-4ac4-8a6d-96663e518d7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:22:51.906217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946feb-ed8f-4ac4-8a6d-96663e518d7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:22:51.908144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-55946feb-ed8f-4ac4-8a6d-96663e518d7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:22:51.925169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55946feb-ed8f-4ac4-8a6d-96663e518d7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:22:51.926658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55946feb-ed8f-4ac4-8a6d-96663e518d7d service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:22:51.943798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1154/2288] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:01.050935 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=36 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:01.936134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=50 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:03.083525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ab358-c3fb-459d-ba29-9784305ecc1b service glance] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:03.111906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ab358-c3fb-459d-ba29-9784305ecc1b service glance] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:03.139091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b2574-7f6e-4309-9181-0ba1c0703c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:03.140044 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b2574-7f6e-4309-9181-0ba1c0703c47 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:03.140660 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b2574-7f6e-4309-9181-0ba1c0703c47 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:03.141192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b2574-7f6e-4309-9181-0ba1c0703c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:03.143807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-672b2574-7f6e-4309-9181-0ba1c0703c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:03.158464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b2574-7f6e-4309-9181-0ba1c0703c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:03.160154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b2574-7f6e-4309-9181-0ba1c0703c47 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:03.186317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1135/2289] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:08.643756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946feb-ed8f-4ac4-8a6d-96663e518d7d service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:08.657064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946feb-ed8f-4ac4-8a6d-96663e518d7d service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:08.663462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4516ee-8ad7-4832-9ff3-4ca8c2bbeafb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:08.664158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4516ee-8ad7-4832-9ff3-4ca8c2bbeafb service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:08.664454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4516ee-8ad7-4832-9ff3-4ca8c2bbeafb service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:08.664870 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4516ee-8ad7-4832-9ff3-4ca8c2bbeafb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:08.667044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fd4516ee-8ad7-4832-9ff3-4ca8c2bbeafb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:08.681944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4516ee-8ad7-4832-9ff3-4ca8c2bbeafb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:08.685383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4516ee-8ad7-4832-9ff3-4ca8c2bbeafb service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:08.703746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1155/2290] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:12.641989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b2574-7f6e-4309-9181-0ba1c0703c47 service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:12.651304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b2574-7f6e-4309-9181-0ba1c0703c47 service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:12.654850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51ff1a-9a4e-4a06-9cc6-78f887f2733c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:12.655458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51ff1a-9a4e-4a06-9cc6-78f887f2733c service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:12.655778 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51ff1a-9a4e-4a06-9cc6-78f887f2733c service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:12.656051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51ff1a-9a4e-4a06-9cc6-78f887f2733c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:12.657776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-1b51ff1a-9a4e-4a06-9cc6-78f887f2733c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:12.669423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51ff1a-9a4e-4a06-9cc6-78f887f2733c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:12.671373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51ff1a-9a4e-4a06-9cc6-78f887f2733c service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:12.680946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1136/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:16.610902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e38d0-d9a4-47b6-acb9-92eb213e1d24 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:16.611802 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e38d0-d9a4-47b6-acb9-92eb213e1d24 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:16.612324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e38d0-d9a4-47b6-acb9-92eb213e1d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:16.650671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9e9e38d0-d9a4-47b6-acb9-92eb213e1d24 None None] MFA Rules not processed for user `be0f76350dc148c6b51705693a1902c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:16.652334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9e9e38d0-d9a4-47b6-acb9-92eb213e1d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:16.667169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1156/2292] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:17.235725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51ff1a-9a4e-4a06-9cc6-78f887f2733c service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:17.246036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51ff1a-9a4e-4a06-9cc6-78f887f2733c service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:17.256551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:17.259083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:17.260242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:17.261560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:17.265352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:17.281430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:17.283036 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:17.293056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1137/2293] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:17.309933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e38d0-d9a4-47b6-acb9-92eb213e1d24 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:17.311497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9e9e38d0-d9a4-47b6-acb9-92eb213e1d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:17.421353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e38d0-d9a4-47b6-acb9-92eb213e1d24 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:17.426813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91aa7d9-59b7-41cc-aaee-e9f161a32342 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:17.427610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91aa7d9-59b7-41cc-aaee-e9f161a32342 service placement] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:17.427935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91aa7d9-59b7-41cc-aaee-e9f161a32342 service placement] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:17.428216 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91aa7d9-59b7-41cc-aaee-e9f161a32342 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:17.430235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b91aa7d9-59b7-41cc-aaee-e9f161a32342 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:17.440549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:17.442064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:17.447169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91aa7d9-59b7-41cc-aaee-e9f161a32342 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:17.449530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91aa7d9-59b7-41cc-aaee-e9f161a32342 service placement] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:17.462880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc872425-d854-4f83-8db1-bbd389421935 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:17.463323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1157/2294] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:17.486584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:17.487790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:17.489011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:17.489515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] PATH_INFO: `/v3/users/04c3b6e933a9414593d7552aa960967d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:17.491323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c3b6e933a9414593d7552aa960967d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:17.493853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:17.718580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c3b6e933a9414593d7552aa960967d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:17.757412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91aa7d9-59b7-41cc-aaee-e9f161a32342 service placement] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:17.768870 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91aa7d9-59b7-41cc-aaee-e9f161a32342 service placement] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:17.774131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69807e-3010-422d-9048-d7bd818063ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:17.774812 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69807e-3010-422d-9048-d7bd818063ad service placement] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:17.775164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69807e-3010-422d-9048-d7bd818063ad service placement] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:17.775445 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69807e-3010-422d-9048-d7bd818063ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:17.777244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6b69807e-3010-422d-9048-d7bd818063ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:17.789804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69807e-3010-422d-9048-d7bd818063ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:17.791357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69807e-3010-422d-9048-d7bd818063ad service placement] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:17.801408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1158/2295] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:23:17.810593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c3b6e933a9414593d7552aa960967d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:17.824215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c3b6e933a9414593d7552aa960967d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:17.824906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c3b6e933a9414593d7552aa960967d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:17.832840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f21c2d9-9fc6-4d4f-93f8-86edfc6daa30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c3b6e933a9414593d7552aa960967d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:17.838755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1138/2296] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:17 2022] DELETE /identity/v3/users/04c3b6e933a9414593d7552aa960967d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:23:18.091434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69807e-3010-422d-9048-d7bd818063ad service placement] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:18.107191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69807e-3010-422d-9048-d7bd818063ad service placement] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:18.196231 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:18.197839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:18.197839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:18.197839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] PATH_INFO: `/v3/projects/bcf0d743dc7d4a03bdab2098b2e5fae0` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:18.198843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf0d743dc7d4a03bdab2098b2e5fae0)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:18.200873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:18.338688 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf0d743dc7d4a03bdab2098b2e5fae0', 'request_id': 'req-3a304c64-2d43-4c43-8bbe-b2bae802c52b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:18.418489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf0d743dc7d4a03bdab2098b2e5fae0', 'request_id': 'req-3a304c64-2d43-4c43-8bbe-b2bae802c52b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:18.423163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:18.431598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf0d743dc7d4a03bdab2098b2e5fae0', 'request_id': 'req-3a304c64-2d43-4c43-8bbe-b2bae802c52b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:18.451839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] The token cache is being invalidate because project bcf0d743dc7d4a03bdab2098b2e5fae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:18.452735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:18.457634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3a304c64-2d43-4c43-8bbe-b2bae802c52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:18.462530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1159/2297] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:18 2022] DELETE /identity/v3/projects/bcf0d743dc7d4a03bdab2098b2e5fae0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:18.464715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fc6e7-f5db-439c-b244-a4a81a04f92c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:18.465195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fc6e7-f5db-439c-b244-a4a81a04f92c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:18.465319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fc6e7-f5db-439c-b244-a4a81a04f92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:18.496138 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-7a2fc6e7-f5db-439c-b244-a4a81a04f92c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:18.497400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7a2fc6e7-f5db-439c-b244-a4a81a04f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:18.569415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1139/2298] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:23:18.577296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caef5fb-5102-4d84-8793-3a1f20581af9 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:18.577669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caef5fb-5102-4d84-8793-3a1f20581af9 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:18.578023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caef5fb-5102-4d84-8793-3a1f20581af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:18.603206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5caef5fb-5102-4d84-8793-3a1f20581af9 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:18.603206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5caef5fb-5102-4d84-8793-3a1f20581af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:18.610560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1160/2299] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:18.615095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fc6e7-f5db-439c-b244-a4a81a04f92c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:18.627033 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fc6e7-f5db-439c-b244-a4a81a04f92c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:18.632082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a38530-7cb6-4616-8011-ad0ef75c6ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:18.632791 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a38530-7cb6-4616-8011-ad0ef75c6ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:18.633078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a38530-7cb6-4616-8011-ad0ef75c6ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:18.633356 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a38530-7cb6-4616-8011-ad0ef75c6ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:18.633999 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a38530-7cb6-4616-8011-ad0ef75c6ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:23:18.634303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a38530-7cb6-4616-8011-ad0ef75c6ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:18.636225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a38530-7cb6-4616-8011-ad0ef75c6ad8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:18.648981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1140/2300] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:23:18.653514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caef5fb-5102-4d84-8793-3a1f20581af9 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:18.662956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caef5fb-5102-4d84-8793-3a1f20581af9 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:18.668045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737b51-1fdf-4b62-903d-855c4718beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:18.668852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737b51-1fdf-4b62-903d-855c4718beb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:18.669301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737b51-1fdf-4b62-903d-855c4718beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:18.669580 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737b51-1fdf-4b62-903d-855c4718beb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:18.670236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737b51-1fdf-4b62-903d-855c4718beb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:18.672711 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737b51-1fdf-4b62-903d-855c4718beb4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:18.833107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1161/2301] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:18 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:23:18.834876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a38530-7cb6-4616-8011-ad0ef75c6ad8 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:18.849092 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a38530-7cb6-4616-8011-ad0ef75c6ad8 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:18.873347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:18.929499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222598c-10f2-40bf-9797-0d6eafa3f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:18.930483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222598c-10f2-40bf-9797-0d6eafa3f2ab admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:18.930975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222598c-10f2-40bf-9797-0d6eafa3f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:18.931463 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222598c-10f2-40bf-9797-0d6eafa3f2ab admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:18.932400 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222598c-10f2-40bf-9797-0d6eafa3f2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:18.935205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222598c-10f2-40bf-9797-0d6eafa3f2ab admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:18.935979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737b51-1fdf-4b62-903d-855c4718beb4 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:18.940434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f6737b51-1fdf-4b62-903d-855c4718beb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:19.006191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1141/2302] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:18 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:19.007855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222598c-10f2-40bf-9797-0d6eafa3f2ab admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:19.022023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222598c-10f2-40bf-9797-0d6eafa3f2ab admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:19.028709 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6788-3901-4a43-98e1-3c1b2b734fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:19.035287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6788-3901-4a43-98e1-3c1b2b734fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:19.035287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6788-3901-4a43-98e1-3c1b2b734fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:19.035287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6788-3901-4a43-98e1-3c1b2b734fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:19.035287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc6788-3901-4a43-98e1-3c1b2b734fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:19.035287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc6788-3901-4a43-98e1-3c1b2b734fe8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:19.037023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737b51-1fdf-4b62-903d-855c4718beb4 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:19.042892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5555d-4b8b-4275-b44e-506882fc0f25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:19.043515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5555d-4b8b-4275-b44e-506882fc0f25 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:19.043886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5555d-4b8b-4275-b44e-506882fc0f25 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:19.044162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5555d-4b8b-4275-b44e-506882fc0f25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:19.046512 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0ab5555d-4b8b-4275-b44e-506882fc0f25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:19.048739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1142/2303] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:23:19.052698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6788-3901-4a43-98e1-3c1b2b734fe8 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:19.070974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6788-3901-4a43-98e1-3c1b2b734fe8 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:19.079884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fb5b-16a6-4121-bd96-c464656ff422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:19.080976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fb5b-16a6-4121-bd96-c464656ff422 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:19.081604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fb5b-16a6-4121-bd96-c464656ff422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:19.081799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fb5b-16a6-4121-bd96-c464656ff422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:19.082465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2fb5b-16a6-4121-bd96-c464656ff422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:19.084225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2fb5b-16a6-4121-bd96-c464656ff422 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:19.101533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1143/2304] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:23:19.105570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fb5b-16a6-4121-bd96-c464656ff422 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:19.122127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fb5b-16a6-4121-bd96-c464656ff422 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:19.128115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17931f7e-296d-41a1-8b14-7a1ee4d75c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:19.128410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931f7e-296d-41a1-8b14-7a1ee4d75c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:19.128585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931f7e-296d-41a1-8b14-7a1ee4d75c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:19.128855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931f7e-296d-41a1-8b14-7a1ee4d75c18 admin admin] PATH_INFO: `/v3/projects/22dc9991d30143aab1051b692893bcc0/users/fc4c2db0b9084b13ab38ad2721ddcc7b/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:19.147030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17931f7e-296d-41a1-8b14-7a1ee4d75c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22dc9991d30143aab1051b692893bcc0, user_id=fc4c2db0b9084b13ab38ad2721ddcc7b, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:19.147898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5555d-4b8b-4275-b44e-506882fc0f25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:19.149568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5555d-4b8b-4275-b44e-506882fc0f25 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:19.150066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17931f7e-296d-41a1-8b14-7a1ee4d75c18 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:19.174615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1162/2305] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:19.250060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1144/2306] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:19 2022] PUT /identity/v3/projects/22dc9991d30143aab1051b692893bcc0/users/fc4c2db0b9084b13ab38ad2721ddcc7b/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:23:19.260565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cccebe-0aec-4024-989b-c46860b2a251 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:19.261055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cccebe-0aec-4024-989b-c46860b2a251 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:19.261713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cccebe-0aec-4024-989b-c46860b2a251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:19.305976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-45cccebe-0aec-4024-989b-c46860b2a251 None None] MFA Rules not processed for user `fc4c2db0b9084b13ab38ad2721ddcc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:19.307445 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-45cccebe-0aec-4024-989b-c46860b2a251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:19.363965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:19.388421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1163/2307] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:23:19.397377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17931f7e-296d-41a1-8b14-7a1ee4d75c18 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:19.399093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-17931f7e-296d-41a1-8b14-7a1ee4d75c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:19.516590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17931f7e-296d-41a1-8b14-7a1ee4d75c18 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:19.522628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522430-2fff-4fe4-856c-fc34017e5917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:19.523265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522430-2fff-4fe4-856c-fc34017e5917 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:19.523549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522430-2fff-4fe4-856c-fc34017e5917 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:19.524140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522430-2fff-4fe4-856c-fc34017e5917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:19.534058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86522430-2fff-4fe4-856c-fc34017e5917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:19.536958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86522430-2fff-4fe4-856c-fc34017e5917 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:19.580723 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1145/2308] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:19.901872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cccebe-0aec-4024-989b-c46860b2a251 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:19.979477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cccebe-0aec-4024-989b-c46860b2a251 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:19.984780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:19.985505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:19.986285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:19.986886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] PATH_INFO: `/v3/users/fc4c2db0b9084b13ab38ad2721ddcc7b` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:19.988229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4c2db0b9084b13ab38ad2721ddcc7b)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:19.990337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:20.129898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522430-2fff-4fe4-856c-fc34017e5917 service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:20.131303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-86522430-2fff-4fe4-856c-fc34017e5917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:20.180534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4c2db0b9084b13ab38ad2721ddcc7b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:20.181790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4c2db0b9084b13ab38ad2721ddcc7b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:20.201618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:20.206311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522430-2fff-4fe4-856c-fc34017e5917 service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:20.210817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67279161-2172-41c9-9e80-9cabbf7f324c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:20.211591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67279161-2172-41c9-9e80-9cabbf7f324c service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:20.211904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67279161-2172-41c9-9e80-9cabbf7f324c service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:20.212182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67279161-2172-41c9-9e80-9cabbf7f324c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:20.214035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-67279161-2172-41c9-9e80-9cabbf7f324c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:20.224634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67279161-2172-41c9-9e80-9cabbf7f324c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:20.226106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67279161-2172-41c9-9e80-9cabbf7f324c service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:20.238414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1146/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:23:20.256745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4c2db0b9084b13ab38ad2721ddcc7b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:20.258652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4c2db0b9084b13ab38ad2721ddcc7b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:20.269867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4c2db0b9084b13ab38ad2721ddcc7b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:20.305679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1164/2310] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:19 2022] DELETE /identity/v3/users/fc4c2db0b9084b13ab38ad2721ddcc7b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:20.306978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46068b-9c79-40f1-9bc2-754980afd60e None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:20.307272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46068b-9c79-40f1-9bc2-754980afd60e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:20.307556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46068b-9c79-40f1-9bc2-754980afd60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:20.334399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-dd46068b-9c79-40f1-9bc2-754980afd60e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:20.335957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-dd46068b-9c79-40f1-9bc2-754980afd60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:20.425240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1147/2311] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:23:20.435101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:20.437116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:20.532862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b1b10-7661-4998-8eff-9950116486ec admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:20.538088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0cf44-0a45-48da-9bfb-026a901ed64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:20.539154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0cf44-0a45-48da-9bfb-026a901ed64b service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:20.539867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0cf44-0a45-48da-9bfb-026a901ed64b service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:20.540350 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0cf44-0a45-48da-9bfb-026a901ed64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:20.556228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0cf44-0a45-48da-9bfb-026a901ed64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:20.559248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0cf44-0a45-48da-9bfb-026a901ed64b service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:20.571825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1165/2312] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:21.188878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46068b-9c79-40f1-9bc2-754980afd60e None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:21.192508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-dd46068b-9c79-40f1-9bc2-754980afd60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:21.214581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46068b-9c79-40f1-9bc2-754980afd60e None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:21.228011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:21.229889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:21.230733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:21.231296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] PATH_INFO: `/v3/projects/22dc9991d30143aab1051b692893bcc0` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:21.232899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=22dc9991d30143aab1051b692893bcc0)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:21.239573 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:21.385785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22dc9991d30143aab1051b692893bcc0', 'request_id': 'req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:21.394753 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22dc9991d30143aab1051b692893bcc0', 'request_id': 'req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:21.535988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22dc9991d30143aab1051b692893bcc0', 'request_id': 'req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:21.551164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] The token cache is being invalidate because project 22dc9991d30143aab1051b692893bcc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:21.551735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:21.552528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4f3c0d9-ba7a-4362-a213-da3f21bd12dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:21.554245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1148/2313] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:21 2022] DELETE /identity/v3/projects/22dc9991d30143aab1051b692893bcc0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:21.559664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d35cf-e03a-4614-a184-53b7532f03a4 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:21.560345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d35cf-e03a-4614-a184-53b7532f03a4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:21.560345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d35cf-e03a-4614-a184-53b7532f03a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:21.574862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:21.581140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-eb5d35cf-e03a-4614-a184-53b7532f03a4 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:21.582367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-eb5d35cf-e03a-4614-a184-53b7532f03a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:21.667783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1166/2314] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:21.674552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad67fa-fa17-4016-bd08-a078d7f6de30 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:21.675066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad67fa-fa17-4016-bd08-a078d7f6de30 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:21.675506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad67fa-fa17-4016-bd08-a078d7f6de30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:21.697288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e0ad67fa-fa17-4016-bd08-a078d7f6de30 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:21.698582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e0ad67fa-fa17-4016-bd08-a078d7f6de30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:21.706970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1149/2315] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:21.711889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d35cf-e03a-4614-a184-53b7532f03a4 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:21.723897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d35cf-e03a-4614-a184-53b7532f03a4 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:21.728853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f313e69-45b0-40c2-8d31-6ff256d4a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:21.729406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f313e69-45b0-40c2-8d31-6ff256d4a506 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:21.729684 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f313e69-45b0-40c2-8d31-6ff256d4a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:21.729953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f313e69-45b0-40c2-8d31-6ff256d4a506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:21.730595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f313e69-45b0-40c2-8d31-6ff256d4a506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:23:21.730895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f313e69-45b0-40c2-8d31-6ff256d4a506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:21.732529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f313e69-45b0-40c2-8d31-6ff256d4a506 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:21.744934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1167/2316] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:23:21.750212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad67fa-fa17-4016-bd08-a078d7f6de30 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:21.759670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad67fa-fa17-4016-bd08-a078d7f6de30 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:21.764456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300ffc0-9263-4415-aef5-952c71a63c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:21.765056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300ffc0-9263-4415-aef5-952c71a63c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:21.765358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300ffc0-9263-4415-aef5-952c71a63c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:21.765850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300ffc0-9263-4415-aef5-952c71a63c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:21.766255 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300ffc0-9263-4415-aef5-952c71a63c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:21.768294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300ffc0-9263-4415-aef5-952c71a63c29 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:21.867962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1150/2317] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:21 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:21.872407 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f313e69-45b0-40c2-8d31-6ff256d4a506 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:21.882527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f313e69-45b0-40c2-8d31-6ff256d4a506 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:21.946739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d1d5e-76b4-4e7d-b5f7-a5cd8837c79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:21.947338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d1d5e-76b4-4e7d-b5f7-a5cd8837c79f admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:21.948551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d1d5e-76b4-4e7d-b5f7-a5cd8837c79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:21.948551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d1d5e-76b4-4e7d-b5f7-a5cd8837c79f admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:21.948831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d1d5e-76b4-4e7d-b5f7-a5cd8837c79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:21.951239 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d1d5e-76b4-4e7d-b5f7-a5cd8837c79f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:22.055730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1168/2318] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:21 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:22.059973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300ffc0-9263-4415-aef5-952c71a63c29 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:22.070742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300ffc0-9263-4415-aef5-952c71a63c29 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:22.077452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39a1d0-2411-467e-849c-73f7028cb6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:22.078131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39a1d0-2411-467e-849c-73f7028cb6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:22.078414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39a1d0-2411-467e-849c-73f7028cb6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:22.078687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39a1d0-2411-467e-849c-73f7028cb6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:22.079342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39a1d0-2411-467e-849c-73f7028cb6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:22.081416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39a1d0-2411-467e-849c-73f7028cb6c1 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:22.095372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1151/2319] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:22.100272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d1d5e-76b4-4e7d-b5f7-a5cd8837c79f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:22.113515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d1d5e-76b4-4e7d-b5f7-a5cd8837c79f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:22.298636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c52fb-b636-4de6-8972-6863cd1c8a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:22.298636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c52fb-b636-4de6-8972-6863cd1c8a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:22.298636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c52fb-b636-4de6-8972-6863cd1c8a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:22.298636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c52fb-b636-4de6-8972-6863cd1c8a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:22.373940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c52fb-b636-4de6-8972-6863cd1c8a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:22.373940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c52fb-b636-4de6-8972-6863cd1c8a7b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:22.373940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1169/2320] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:22.375738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39a1d0-2411-467e-849c-73f7028cb6c1 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:22.375738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39a1d0-2411-467e-849c-73f7028cb6c1 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:22.375738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4450-2181-426c-b490-6a6175cdea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:22.375738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4450-2181-426c-b490-6a6175cdea92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:22.376936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4450-2181-426c-b490-6a6175cdea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:22.376936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4450-2181-426c-b490-6a6175cdea92 admin admin] PATH_INFO: `/v3/projects/c3d385fcce274d41997e645649b7d817/users/7a411aca364e40e8a0a5d9315d74649d/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:22.376936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f4450-2181-426c-b490-6a6175cdea92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d385fcce274d41997e645649b7d817, user_id=7a411aca364e40e8a0a5d9315d74649d, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:22.376936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f4450-2181-426c-b490-6a6175cdea92 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:22.381291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1152/2321] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:22 2022] PUT /identity/v3/projects/c3d385fcce274d41997e645649b7d817/users/7a411aca364e40e8a0a5d9315d74649d/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:23:22.392500 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb951d-d743-4608-a892-e3411d2e2392 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:22.392766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb951d-d743-4608-a892-e3411d2e2392 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:22.393038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb951d-d743-4608-a892-e3411d2e2392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:22.430004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-47eb951d-d743-4608-a892-e3411d2e2392 None None] MFA Rules not processed for user `7a411aca364e40e8a0a5d9315d74649d`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:22.431380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-47eb951d-d743-4608-a892-e3411d2e2392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:22.513572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1170/2322] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:22.519363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4450-2181-426c-b490-6a6175cdea92 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:22.534376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:22.589686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4450-2181-426c-b490-6a6175cdea92 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:22.605686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229f27-0b90-4aec-93cb-5653fcb1792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:22.606286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229f27-0b90-4aec-93cb-5653fcb1792e admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:22.606572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229f27-0b90-4aec-93cb-5653fcb1792e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:22.606882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229f27-0b90-4aec-93cb-5653fcb1792e admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:22.607535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca229f27-0b90-4aec-93cb-5653fcb1792e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:22.609493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca229f27-0b90-4aec-93cb-5653fcb1792e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:22.705277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1153/2323] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:22 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:22.709698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb951d-d743-4608-a892-e3411d2e2392 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:22.715275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:22.721760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb951d-d743-4608-a892-e3411d2e2392 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:22.779940 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d5793-98e6-4a54-9f66-d6202d4bbed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:22.780608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d5793-98e6-4a54-9f66-d6202d4bbed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:22.780894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d5793-98e6-4a54-9f66-d6202d4bbed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:22.781175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d5793-98e6-4a54-9f66-d6202d4bbed9 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:22.781822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d5793-98e6-4a54-9f66-d6202d4bbed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:22.783863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d5793-98e6-4a54-9f66-d6202d4bbed9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:22.886028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1171/2324] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:22 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:22.887166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229f27-0b90-4aec-93cb-5653fcb1792e admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:22.897909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229f27-0b90-4aec-93cb-5653fcb1792e admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:22.903175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739b3d-2cf0-4f6a-827f-839dd404f90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:22.903835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739b3d-2cf0-4f6a-827f-839dd404f90c admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:22.910516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739b3d-2cf0-4f6a-827f-839dd404f90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:22.910516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739b3d-2cf0-4f6a-827f-839dd404f90c admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:22.910516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739b3d-2cf0-4f6a-827f-839dd404f90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:22.910516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739b3d-2cf0-4f6a-827f-839dd404f90c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:22.917537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1154/2325] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:22.922411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d5793-98e6-4a54-9f66-d6202d4bbed9 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:22.932498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d5793-98e6-4a54-9f66-d6202d4bbed9 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:22.938160 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c3a62-7b0c-468b-b4af-477318fb2dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:22.938677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c3a62-7b0c-468b-b4af-477318fb2dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:22.939083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c3a62-7b0c-468b-b4af-477318fb2dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:22.939366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c3a62-7b0c-468b-b4af-477318fb2dc9 admin admin] PATH_INFO: `/v3/projects/2cdc048d52dd46979aaadb29edd0fe14/users/5b8b84e21ec3417e836956784e214ef9/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:22.954694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c3a62-7b0c-468b-b4af-477318fb2dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cdc048d52dd46979aaadb29edd0fe14, user_id=5b8b84e21ec3417e836956784e214ef9, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:22.958170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c3a62-7b0c-468b-b4af-477318fb2dc9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:23.031911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1172/2326] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:22 2022] PUT /identity/v3/projects/2cdc048d52dd46979aaadb29edd0fe14/users/5b8b84e21ec3417e836956784e214ef9/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:23:23.036151 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739b3d-2cf0-4f6a-827f-839dd404f90c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:23.062957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739b3d-2cf0-4f6a-827f-839dd404f90c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:23.138896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1e306-f7d2-4d53-b923-7ad7b5375f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:23.139475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e306-f7d2-4d53-b923-7ad7b5375f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:23.139910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e306-f7d2-4d53-b923-7ad7b5375f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:23.140290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e306-f7d2-4d53-b923-7ad7b5375f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:23.141038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1e306-f7d2-4d53-b923-7ad7b5375f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:23.142718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1e306-f7d2-4d53-b923-7ad7b5375f5f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:23.155689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1155/2327] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:23.157072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c3a62-7b0c-468b-b4af-477318fb2dc9 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:23.167477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c3a62-7b0c-468b-b4af-477318fb2dc9 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:23.172891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ac521-dae3-4880-bdf6-a4b07c9abc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:23.173581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac521-dae3-4880-bdf6-a4b07c9abc1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:23.173866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac521-dae3-4880-bdf6-a4b07c9abc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:23.174147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac521-dae3-4880-bdf6-a4b07c9abc1c admin admin] PATH_INFO: `/v3/projects/2cdc048d52dd46979aaadb29edd0fe14/users/5b8b84e21ec3417e836956784e214ef9/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:23.176139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ac521-dae3-4880-bdf6-a4b07c9abc1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cdc048d52dd46979aaadb29edd0fe14, user_id=5b8b84e21ec3417e836956784e214ef9, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:23.178814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ac521-dae3-4880-bdf6-a4b07c9abc1c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:23.191673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1173/2328] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:23 2022] PUT /identity/v3/projects/2cdc048d52dd46979aaadb29edd0fe14/users/5b8b84e21ec3417e836956784e214ef9/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:23.203914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604623d-568e-4126-b6de-bdb2d3e75bd4 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:23.204274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604623d-568e-4126-b6de-bdb2d3e75bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:23.204554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604623d-568e-4126-b6de-bdb2d3e75bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:23.236960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6604623d-568e-4126-b6de-bdb2d3e75bd4 None None] MFA Rules not processed for user `5b8b84e21ec3417e836956784e214ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:23.238220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6604623d-568e-4126-b6de-bdb2d3e75bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:23.308509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1156/2329] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:23.320051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ac521-dae3-4880-bdf6-a4b07c9abc1c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:23.321809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7f9ac521-dae3-4880-bdf6-a4b07c9abc1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:23.384002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ac521-dae3-4880-bdf6-a4b07c9abc1c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:23.387697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafae5b0-dfd4-49b1-a184-48be25ffff14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:23.388318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae5b0-dfd4-49b1-a184-48be25ffff14 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:23.388596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae5b0-dfd4-49b1-a184-48be25ffff14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:23.388873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae5b0-dfd4-49b1-a184-48be25ffff14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:23.398819 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafae5b0-dfd4-49b1-a184-48be25ffff14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:23.400235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafae5b0-dfd4-49b1-a184-48be25ffff14 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:23.410724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1174/2330] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:23:23.551087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604623d-568e-4126-b6de-bdb2d3e75bd4 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:23.561300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604623d-568e-4126-b6de-bdb2d3e75bd4 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:23.565314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805c1fc-eeb8-468c-b9e2-756d415a21d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:23.566020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c1fc-eeb8-468c-b9e2-756d415a21d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:23.566347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c1fc-eeb8-468c-b9e2-756d415a21d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:23.566754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c1fc-eeb8-468c-b9e2-756d415a21d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:23.572450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:23.635304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805c1fc-eeb8-468c-b9e2-756d415a21d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:23.636495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805c1fc-eeb8-468c-b9e2-756d415a21d2 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:23.648938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1157/2331] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:23:28.478724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafae5b0-dfd4-49b1-a184-48be25ffff14 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:28.480452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bafae5b0-dfd4-49b1-a184-48be25ffff14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:28.573396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:28.580324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafae5b0-dfd4-49b1-a184-48be25ffff14 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:28.585659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:28.588391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:28.588391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:28.588391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] PATH_INFO: `/v3/users/0e2f894e9b674aa09dda2400d810b6be` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:28.588391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2f894e9b674aa09dda2400d810b6be)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:28.590112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:28.805576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805c1fc-eeb8-468c-b9e2-756d415a21d2 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:28.819468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805c1fc-eeb8-468c-b9e2-756d415a21d2 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:28.824346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:28.824977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:28.825267 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:28.825534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] PATH_INFO: `/v3/users/7a411aca364e40e8a0a5d9315d74649d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:28.826750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a411aca364e40e8a0a5d9315d74649d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:28.828706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:28.829345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2f894e9b674aa09dda2400d810b6be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:28.829991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2f894e9b674aa09dda2400d810b6be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:28.957803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2f894e9b674aa09dda2400d810b6be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:28.958503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2f894e9b674aa09dda2400d810b6be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:28.966101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d897d65a-ddfb-4f80-8770-d766344ae8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2f894e9b674aa09dda2400d810b6be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:28.983579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1175/2332] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:28 2022] DELETE /identity/v3/users/0e2f894e9b674aa09dda2400d810b6be => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:29.067858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a411aca364e40e8a0a5d9315d74649d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.151928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a411aca364e40e8a0a5d9315d74649d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.166936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a411aca364e40e8a0a5d9315d74649d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.167872 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a411aca364e40e8a0a5d9315d74649d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.175839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a411aca364e40e8a0a5d9315d74649d'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.182213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1158/2333] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:28 2022] DELETE /identity/v3/users/7a411aca364e40e8a0a5d9315d74649d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:23:29.189444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921003-20bc-44d5-b973-b044d1f15bf0 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:29.189732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921003-20bc-44d5-b973-b044d1f15bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:29.196945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921003-20bc-44d5-b973-b044d1f15bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:29.218220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-57921003-20bc-44d5-b973-b044d1f15bf0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:29.219274 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-57921003-20bc-44d5-b973-b044d1f15bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:29.283520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1176/2334] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:29.294070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:29.295591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:29.308986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57921003-20bc-44d5-b973-b044d1f15bf0 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:29.311799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-57921003-20bc-44d5-b973-b044d1f15bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:29.341913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57921003-20bc-44d5-b973-b044d1f15bf0 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:29.354065 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:29.355005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:29.355290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:29.355750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] PATH_INFO: `/v3/projects/feb9c4f260af434c9f70eaeb03f69eba` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:29.356822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb9c4f260af434c9f70eaeb03f69eba)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:29.358715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:29.461073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331183b0-44e0-46fd-9668-6d03ec01c128 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:29.476040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb9c4f260af434c9f70eaeb03f69eba', 'request_id': 'req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.508850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:29.533403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5af547-2de4-4588-80fe-e8ae7ccee573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:29.534363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af547-2de4-4588-80fe-e8ae7ccee573 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:29.534844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af547-2de4-4588-80fe-e8ae7ccee573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:29.535334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af547-2de4-4588-80fe-e8ae7ccee573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:29.556721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb9c4f260af434c9f70eaeb03f69eba', 'request_id': 'req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.568406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb9c4f260af434c9f70eaeb03f69eba', 'request_id': 'req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.578235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:29.585332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] The token cache is being invalidate because project feb9c4f260af434c9f70eaeb03f69eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:29.588976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.588976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:29.588976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1177/2335] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:29 2022] DELETE /identity/v3/projects/feb9c4f260af434c9f70eaeb03f69eba => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:23:29.622059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af547-2de4-4588-80fe-e8ae7ccee573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:29.624300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af547-2de4-4588-80fe-e8ae7ccee573 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:29.640419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1159/2336] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:30.341348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:30.342784 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:30.356769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9439-1dcb-43e6-b4bc-cf60fa27ed56 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:30.362018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:30.362693 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:30.363142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:30.363448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] PATH_INFO: `/v3/projects/c3d385fcce274d41997e645649b7d817` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:30.364730 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d385fcce274d41997e645649b7d817)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:30.366942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:30.483658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d385fcce274d41997e645649b7d817', 'request_id': 'req-266a499a-92dc-4c65-a20c-faa112b9b9da'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.533825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d385fcce274d41997e645649b7d817', 'request_id': 'req-266a499a-92dc-4c65-a20c-faa112b9b9da'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.540549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d385fcce274d41997e645649b7d817', 'request_id': 'req-266a499a-92dc-4c65-a20c-faa112b9b9da'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.552006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] The token cache is being invalidate because project c3d385fcce274d41997e645649b7d817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:30.552290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.552934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.554421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1178/2337] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:30 2022] DELETE /identity/v3/projects/c3d385fcce274d41997e645649b7d817 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:30.558654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5af547-2de4-4588-80fe-e8ae7ccee573 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:30.560159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-1c5af547-2de4-4588-80fe-e8ae7ccee573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:30.573773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5af547-2de4-4588-80fe-e8ae7ccee573 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:30.630804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:30.631352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:30.631650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:30.631923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] PATH_INFO: `/v3/users/5b8b84e21ec3417e836956784e214ef9` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:30.633030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8b84e21ec3417e836956784e214ef9)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:30.634932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:30.816953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8b84e21ec3417e836956784e214ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.917357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8b84e21ec3417e836956784e214ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.933132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8b84e21ec3417e836956784e214ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.933453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8b84e21ec3417e836956784e214ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.940655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0f92ee65-7932-469d-8ef7-1e98441613c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8b84e21ec3417e836956784e214ef9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:30.948850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1160/2338] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:30 2022] DELETE /identity/v3/users/5b8b84e21ec3417e836956784e214ef9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:31.337615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:31.338298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:31.352077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a499a-92dc-4c65-a20c-faa112b9b9da admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:31.422202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:31.422925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:31.423220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:31.423498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] PATH_INFO: `/v3/projects/2cdc048d52dd46979aaadb29edd0fe14` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:31.424745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cdc048d52dd46979aaadb29edd0fe14)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:31.429577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:31.730589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cdc048d52dd46979aaadb29edd0fe14', 'request_id': 'req-5ec4a581-dd46-4748-b774-bbf7800a84d3'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:31.859899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cdc048d52dd46979aaadb29edd0fe14', 'request_id': 'req-5ec4a581-dd46-4748-b774-bbf7800a84d3'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:31.868668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cdc048d52dd46979aaadb29edd0fe14', 'request_id': 'req-5ec4a581-dd46-4748-b774-bbf7800a84d3'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:31.881993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] The token cache is being invalidate because project 2cdc048d52dd46979aaadb29edd0fe14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:31.882280 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:31.883141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5ec4a581-dd46-4748-b774-bbf7800a84d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:31.884799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1179/2339] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:31 2022] DELETE /identity/v3/projects/2cdc048d52dd46979aaadb29edd0fe14 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:31.891042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23b177-263d-48ce-a25d-c0e9d5a23050 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:31.891592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23b177-263d-48ce-a25d-c0e9d5a23050 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:31.891592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23b177-263d-48ce-a25d-c0e9d5a23050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:31.900042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:31.913245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ca23b177-263d-48ce-a25d-c0e9d5a23050 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:31.914569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ca23b177-263d-48ce-a25d-c0e9d5a23050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:31.979693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1161/2340] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:31.987516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef2574-83ac-4f3b-b158-b3bbc9a28d26 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:31.987861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef2574-83ac-4f3b-b158-b3bbc9a28d26 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:31.988152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef2574-83ac-4f3b-b158-b3bbc9a28d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:32.008267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-deef2574-83ac-4f3b-b158-b3bbc9a28d26 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:32.018419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-deef2574-83ac-4f3b-b158-b3bbc9a28d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:32.027095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1180/2341] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:32.031535 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23b177-263d-48ce-a25d-c0e9d5a23050 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:32.042770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23b177-263d-48ce-a25d-c0e9d5a23050 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:32.048883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9357d8c-cfbd-4e10-af54-56f779a0a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:32.049520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9357d8c-cfbd-4e10-af54-56f779a0a8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:32.060004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9357d8c-cfbd-4e10-af54-56f779a0a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:32.060004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9357d8c-cfbd-4e10-af54-56f779a0a8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:32.060004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9357d8c-cfbd-4e10-af54-56f779a0a8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:23:32.060004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9357d8c-cfbd-4e10-af54-56f779a0a8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:32.060004 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9357d8c-cfbd-4e10-af54-56f779a0a8f9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:32.076863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1162/2342] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:23:32.078570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef2574-83ac-4f3b-b158-b3bbc9a28d26 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:32.090137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef2574-83ac-4f3b-b158-b3bbc9a28d26 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:32.095108 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061367a6-3a11-4675-b775-60bb00404afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:32.096331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061367a6-3a11-4675-b775-60bb00404afe admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:32.096617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061367a6-3a11-4675-b775-60bb00404afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:32.096892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061367a6-3a11-4675-b775-60bb00404afe admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:32.097560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061367a6-3a11-4675-b775-60bb00404afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:32.100230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061367a6-3a11-4675-b775-60bb00404afe admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:32.105342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:32.242894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1181/2343] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:32 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:32.243685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9357d8c-cfbd-4e10-af54-56f779a0a8f9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:32.254510 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9357d8c-cfbd-4e10-af54-56f779a0a8f9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:32.327723 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264cba1-fcaa-480e-a63d-7a24faa59d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:32.328321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264cba1-fcaa-480e-a63d-7a24faa59d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:32.328608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264cba1-fcaa-480e-a63d-7a24faa59d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:32.328892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264cba1-fcaa-480e-a63d-7a24faa59d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:32.329568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264cba1-fcaa-480e-a63d-7a24faa59d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:32.332512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264cba1-fcaa-480e-a63d-7a24faa59d9c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:32.475026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1163/2344] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:32 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:23:32.476546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061367a6-3a11-4675-b775-60bb00404afe admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:32.486937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061367a6-3a11-4675-b775-60bb00404afe admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:32.491573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14d88-70d6-4f2b-81eb-f4835f484189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:32.492213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14d88-70d6-4f2b-81eb-f4835f484189 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:32.492814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14d88-70d6-4f2b-81eb-f4835f484189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:32.493091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14d88-70d6-4f2b-81eb-f4835f484189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:32.493747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db14d88-70d6-4f2b-81eb-f4835f484189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:32.495347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db14d88-70d6-4f2b-81eb-f4835f484189 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:32.511864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1182/2345] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:32.513172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264cba1-fcaa-480e-a63d-7a24faa59d9c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:32.526517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264cba1-fcaa-480e-a63d-7a24faa59d9c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:32.531583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5fee6-08e9-4eed-97bd-24674bd07de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:32.532235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5fee6-08e9-4eed-97bd-24674bd07de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:32.532599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5fee6-08e9-4eed-97bd-24674bd07de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:32.533282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5fee6-08e9-4eed-97bd-24674bd07de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:32.535030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5fee6-08e9-4eed-97bd-24674bd07de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:32.537981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5fee6-08e9-4eed-97bd-24674bd07de8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:32.551120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1164/2346] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:32.555886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14d88-70d6-4f2b-81eb-f4835f484189 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:32.568403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14d88-70d6-4f2b-81eb-f4835f484189 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:32.580839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfa8f2-45da-45e7-80c9-4e5d87bd468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:32.582130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfa8f2-45da-45e7-80c9-4e5d87bd468e admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:32.582505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfa8f2-45da-45e7-80c9-4e5d87bd468e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:32.583225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfa8f2-45da-45e7-80c9-4e5d87bd468e admin admin] PATH_INFO: `/v3/projects/4625323e4bc34befb35b34458520adfa/users/8e8d2119f6714228ad4e28cf57e03392/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:32.605520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfa8f2-45da-45e7-80c9-4e5d87bd468e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4625323e4bc34befb35b34458520adfa, user_id=8e8d2119f6714228ad4e28cf57e03392, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:32.608227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfa8f2-45da-45e7-80c9-4e5d87bd468e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:32.690190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1183/2347] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:32 2022] PUT /identity/v3/projects/4625323e4bc34befb35b34458520adfa/users/8e8d2119f6714228ad4e28cf57e03392/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:32.701049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40d1b-998d-4c06-bed0-874631f463ed None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:32.701334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40d1b-998d-4c06-bed0-874631f463ed None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:32.701609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40d1b-998d-4c06-bed0-874631f463ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:32.730725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f2f40d1b-998d-4c06-bed0-874631f463ed None None] MFA Rules not processed for user `8e8d2119f6714228ad4e28cf57e03392`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:32.731990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f2f40d1b-998d-4c06-bed0-874631f463ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:32.795352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:32.801024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1165/2348] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:32.805573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfa8f2-45da-45e7-80c9-4e5d87bd468e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:32.873748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfa8f2-45da-45e7-80c9-4e5d87bd468e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:32.879516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d67ed-06e2-4ccf-9379-164fd0659a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:32.880174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d67ed-06e2-4ccf-9379-164fd0659a83 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:32.880463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d67ed-06e2-4ccf-9379-164fd0659a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:32.880740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d67ed-06e2-4ccf-9379-164fd0659a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:32.881421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d67ed-06e2-4ccf-9379-164fd0659a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:32.883295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d67ed-06e2-4ccf-9379-164fd0659a83 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:32.971022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1184/2349] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:32 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:32.975479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40d1b-998d-4c06-bed0-874631f463ed None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:32.989619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40d1b-998d-4c06-bed0-874631f463ed None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:33.052972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358c571-0200-4dcf-a54d-950cbfb04511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:33.053561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358c571-0200-4dcf-a54d-950cbfb04511 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:33.054425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358c571-0200-4dcf-a54d-950cbfb04511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:33.054425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358c571-0200-4dcf-a54d-950cbfb04511 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:33.054922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358c571-0200-4dcf-a54d-950cbfb04511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:33.056962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358c571-0200-4dcf-a54d-950cbfb04511 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:33.167167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1166/2350] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:32 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:33.168511 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d67ed-06e2-4ccf-9379-164fd0659a83 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:33.180857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d67ed-06e2-4ccf-9379-164fd0659a83 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:33.185915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddd611-4bd3-40f3-ae9a-1ba3950fd7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:33.187087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddd611-4bd3-40f3-ae9a-1ba3950fd7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:33.187374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddd611-4bd3-40f3-ae9a-1ba3950fd7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:33.187681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddd611-4bd3-40f3-ae9a-1ba3950fd7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:33.188567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddd611-4bd3-40f3-ae9a-1ba3950fd7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:33.190786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddd611-4bd3-40f3-ae9a-1ba3950fd7b0 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:33.202884 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1185/2351] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:33.208134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358c571-0200-4dcf-a54d-950cbfb04511 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:33.218793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358c571-0200-4dcf-a54d-950cbfb04511 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:33.223527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51df3a1-80ac-40e9-bc3f-4bdb62987198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:33.224234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51df3a1-80ac-40e9-bc3f-4bdb62987198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:33.224727 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51df3a1-80ac-40e9-bc3f-4bdb62987198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:33.224936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51df3a1-80ac-40e9-bc3f-4bdb62987198 admin admin] PATH_INFO: `/v3/projects/cf8da7451d3144d4b26f9d0aad0a4643/users/e82025ad777a43b4a76d6aaf33049b50/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:33.240330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51df3a1-80ac-40e9-bc3f-4bdb62987198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8da7451d3144d4b26f9d0aad0a4643, user_id=e82025ad777a43b4a76d6aaf33049b50, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:33.242988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51df3a1-80ac-40e9-bc3f-4bdb62987198 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:33.329534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1167/2352] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:33 2022] PUT /identity/v3/projects/cf8da7451d3144d4b26f9d0aad0a4643/users/e82025ad777a43b4a76d6aaf33049b50/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:33.334550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddd611-4bd3-40f3-ae9a-1ba3950fd7b0 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:33.344929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddd611-4bd3-40f3-ae9a-1ba3950fd7b0 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:33.405283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902abe9-09f2-408a-aa7e-0527e974af7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:33.405904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902abe9-09f2-408a-aa7e-0527e974af7e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:33.406187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902abe9-09f2-408a-aa7e-0527e974af7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:33.406460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902abe9-09f2-408a-aa7e-0527e974af7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:33.407137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902abe9-09f2-408a-aa7e-0527e974af7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:33.408895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902abe9-09f2-408a-aa7e-0527e974af7e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:33.418967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1186/2353] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:33.423120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51df3a1-80ac-40e9-bc3f-4bdb62987198 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:33.434953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51df3a1-80ac-40e9-bc3f-4bdb62987198 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:33.440532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a404da0-4701-4558-b348-2e35e0e0868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:33.441294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a404da0-4701-4558-b348-2e35e0e0868c admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:33.441704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a404da0-4701-4558-b348-2e35e0e0868c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:33.442252 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a404da0-4701-4558-b348-2e35e0e0868c admin admin] PATH_INFO: `/v3/projects/cf8da7451d3144d4b26f9d0aad0a4643/users/e82025ad777a43b4a76d6aaf33049b50/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:33.444204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a404da0-4701-4558-b348-2e35e0e0868c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8da7451d3144d4b26f9d0aad0a4643, user_id=e82025ad777a43b4a76d6aaf33049b50, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:33.446952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a404da0-4701-4558-b348-2e35e0e0868c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:33.458611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1168/2354] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:33 2022] PUT /identity/v3/projects/cf8da7451d3144d4b26f9d0aad0a4643/users/e82025ad777a43b4a76d6aaf33049b50/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:33.470763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd42d50-c374-4fdd-99e5-4022a6b05855 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:33.471172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd42d50-c374-4fdd-99e5-4022a6b05855 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:33.471517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd42d50-c374-4fdd-99e5-4022a6b05855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:33.571312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a404da0-4701-4558-b348-2e35e0e0868c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:33.573325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7a404da0-4701-4558-b348-2e35e0e0868c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:33.633510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6bd42d50-c374-4fdd-99e5-4022a6b05855 None None] MFA Rules not processed for user `e82025ad777a43b4a76d6aaf33049b50`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:33.634714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6bd42d50-c374-4fdd-99e5-4022a6b05855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:33.643829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:33.686523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a404da0-4701-4558-b348-2e35e0e0868c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:33.693038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405d91-7883-43ab-a050-e93d9acb111e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:33.693677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405d91-7883-43ab-a050-e93d9acb111e service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:33.693964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405d91-7883-43ab-a050-e93d9acb111e service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:33.694243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405d91-7883-43ab-a050-e93d9acb111e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:33.696155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9f405d91-7883-43ab-a050-e93d9acb111e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:33.709544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f405d91-7883-43ab-a050-e93d9acb111e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:33.711204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f405d91-7883-43ab-a050-e93d9acb111e service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:33.721176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1187/2355] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:33.723899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1169/2356] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:23:33.733839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd42d50-c374-4fdd-99e5-4022a6b05855 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:33.735263 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6bd42d50-c374-4fdd-99e5-4022a6b05855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:33.809611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd42d50-c374-4fdd-99e5-4022a6b05855 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:33.813899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231dcfd-91f4-4c81-85f1-2a124c25547a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:33.814625 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231dcfd-91f4-4c81-85f1-2a124c25547a service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:33.815040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231dcfd-91f4-4c81-85f1-2a124c25547a service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:33.815514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231dcfd-91f4-4c81-85f1-2a124c25547a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:33.826358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231dcfd-91f4-4c81-85f1-2a124c25547a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:33.828133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231dcfd-91f4-4c81-85f1-2a124c25547a service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:33.842229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1188/2357] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:35.153073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405d91-7883-43ab-a050-e93d9acb111e service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:35.164447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405d91-7883-43ab-a050-e93d9acb111e service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:35.169775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce4d42-274c-47a2-87b3-1855dddef226 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82025ad777a43b4a76d6aaf33049b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf8da7451d3144d4b26f9d0aad0a4643', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:35.170414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce4d42-274c-47a2-87b3-1855dddef226 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:35.170695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce4d42-274c-47a2-87b3-1855dddef226 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:35.170966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce4d42-274c-47a2-87b3-1855dddef226 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:35.171679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce4d42-274c-47a2-87b3-1855dddef226 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:23:35.171998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce4d42-274c-47a2-87b3-1855dddef226 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:35.173584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce4d42-274c-47a2-87b3-1855dddef226 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:35.186803 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1170/2358] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:23:35.190855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231dcfd-91f4-4c81-85f1-2a124c25547a service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:35.200767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231dcfd-91f4-4c81-85f1-2a124c25547a service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:35.205706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e47bb-d16e-4abe-a9e2-3120d93d7e29 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82025ad777a43b4a76d6aaf33049b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf8da7451d3144d4b26f9d0aad0a4643', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:35.206335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e47bb-d16e-4abe-a9e2-3120d93d7e29 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:35.206620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e47bb-d16e-4abe-a9e2-3120d93d7e29 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:35.206899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e47bb-d16e-4abe-a9e2-3120d93d7e29 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:35.207529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e47bb-d16e-4abe-a9e2-3120d93d7e29 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:35.209443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e47bb-d16e-4abe-a9e2-3120d93d7e29 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:35.291351 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1189/2359] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:35 2022] POST /identity/v3/projects => generated 354 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:35.295564 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce4d42-274c-47a2-87b3-1855dddef226 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:35.306177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce4d42-274c-47a2-87b3-1855dddef226 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:35.326419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:35.369250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82025ad777a43b4a76d6aaf33049b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf8da7451d3144d4b26f9d0aad0a4643', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:35.372581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:35.372581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:35.372581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:35.372581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:23:35.372581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:35.373038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:35.385613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1171/2360] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:23:35.432838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e47bb-d16e-4abe-a9e2-3120d93d7e29 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:35.445230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e47bb-d16e-4abe-a9e2-3120d93d7e29 tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:35.453229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82025ad777a43b4a76d6aaf33049b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf8da7451d3144d4b26f9d0aad0a4643', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:35.454096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:35.454477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:35.454938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] PATH_INFO: `/v3/projects/7f6a6d1fd7ae44e59124999f6950004d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:35.457055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7f6a6d1fd7ae44e59124999f6950004d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:35.459546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:35.643480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6a6d1fd7ae44e59124999f6950004d', 'request_id': 'req-0837b18d-ecc3-483c-9bf6-61a8d03a450b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:35.740391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6a6d1fd7ae44e59124999f6950004d', 'request_id': 'req-0837b18d-ecc3-483c-9bf6-61a8d03a450b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:35.748049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6a6d1fd7ae44e59124999f6950004d', 'request_id': 'req-0837b18d-ecc3-483c-9bf6-61a8d03a450b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:35.762583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] The token cache is being invalidate because project 7f6a6d1fd7ae44e59124999f6950004d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:35.762873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:35.763567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:35.765644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1190/2361] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:35 2022] DELETE /identity/v3/projects/7f6a6d1fd7ae44e59124999f6950004d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:35.845194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:35.847682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:35.908821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0a1d-47f6-43f1-9924-48be47b3bc9e tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:35.958506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5e164-ad7e-4817-b882-e61260698a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:35.959179 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e164-ad7e-4817-b882-e61260698a1e service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:35.959407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e164-ad7e-4817-b882-e61260698a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:35.959706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e164-ad7e-4817-b882-e61260698a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:35.961534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-66b5e164-ad7e-4817-b882-e61260698a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:35.973596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5e164-ad7e-4817-b882-e61260698a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:35.975049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5e164-ad7e-4817-b882-e61260698a1e service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:35.983698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1172/2362] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:36.389817 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:36.391504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:36.405568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:36.499539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837b18d-ecc3-483c-9bf6-61a8d03a450b tempest-VolumeQuotaClassesTest-1208461351 tempest-VolumeQuotaClassesTest-1208461351-project-admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:36.504175 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:36.504815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:36.505636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:36.505636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] PATH_INFO: `/v3/users/8e8d2119f6714228ad4e28cf57e03392` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:36.506485 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8d2119f6714228ad4e28cf57e03392)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:36.508433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:36.684620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8d2119f6714228ad4e28cf57e03392'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:36.685541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8d2119f6714228ad4e28cf57e03392'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:36.769132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8d2119f6714228ad4e28cf57e03392'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:36.769753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8d2119f6714228ad4e28cf57e03392'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:36.777346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8d2119f6714228ad4e28cf57e03392'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:36.796572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1191/2363] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:36 2022] DELETE /identity/v3/users/8e8d2119f6714228ad4e28cf57e03392 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:36.801085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ca08-a844-4108-a0ff-2ae6a1c967dd None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:36.801597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ca08-a844-4108-a0ff-2ae6a1c967dd None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:36.801697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ca08-a844-4108-a0ff-2ae6a1c967dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:36.821149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f5a9ca08-a844-4108-a0ff-2ae6a1c967dd None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:36.822403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f5a9ca08-a844-4108-a0ff-2ae6a1c967dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:36.882299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1173/2364] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:36.892410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:36.894272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:36.952367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7fde0-6939-4400-bea7-9fe97b88084a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:36.956480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08060a50-87f4-4218-b135-d21b56bf54e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:36.957083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08060a50-87f4-4218-b135-d21b56bf54e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:36.957360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08060a50-87f4-4218-b135-d21b56bf54e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:36.957659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08060a50-87f4-4218-b135-d21b56bf54e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:36.966623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08060a50-87f4-4218-b135-d21b56bf54e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:36.968105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08060a50-87f4-4218-b135-d21b56bf54e0 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:36.978174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1192/2365] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:23:37.247007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ca08-a844-4108-a0ff-2ae6a1c967dd None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:37.247007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f5a9ca08-a844-4108-a0ff-2ae6a1c967dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:37.260208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:37.316448 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ca08-a844-4108-a0ff-2ae6a1c967dd None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:37.322183 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d378-a7a6-4a84-ad14-3209b55462b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:37.322798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d378-a7a6-4a84-ad14-3209b55462b7 service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:37.323093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d378-a7a6-4a84-ad14-3209b55462b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:37.323373 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d378-a7a6-4a84-ad14-3209b55462b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:37.325777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4418d378-a7a6-4a84-ad14-3209b55462b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:37.341122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d378-a7a6-4a84-ad14-3209b55462b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:37.342793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d378-a7a6-4a84-ad14-3209b55462b7 service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:37.354468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1174/2366] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:37.404737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08060a50-87f4-4218-b135-d21b56bf54e0 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:37.413445 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-08060a50-87f4-4218-b135-d21b56bf54e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:37.421094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08060a50-87f4-4218-b135-d21b56bf54e0 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:37.426226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:37.426871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:37.427159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:37.427611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] PATH_INFO: `/v3/projects/4625323e4bc34befb35b34458520adfa` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:37.428786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4625323e4bc34befb35b34458520adfa)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:37.430761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:37.507428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:37.524673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4625323e4bc34befb35b34458520adfa', 'request_id': 'req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.602824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4625323e4bc34befb35b34458520adfa', 'request_id': 'req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.609732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4625323e4bc34befb35b34458520adfa', 'request_id': 'req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.620598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] The token cache is being invalidate because project 4625323e4bc34befb35b34458520adfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:37.620887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.621547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.623263 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1193/2367] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:37 2022] DELETE /identity/v3/projects/4625323e4bc34befb35b34458520adfa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:37.627598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d378-a7a6-4a84-ad14-3209b55462b7 service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:37.637912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d378-a7a6-4a84-ad14-3209b55462b7 service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:37.697557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:37.698229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:37.698517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:37.698796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] PATH_INFO: `/v3/users/e82025ad777a43b4a76d6aaf33049b50` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:37.699954 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82025ad777a43b4a76d6aaf33049b50)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:37.701874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:37.899158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82025ad777a43b4a76d6aaf33049b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.951372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82025ad777a43b4a76d6aaf33049b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.965013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82025ad777a43b4a76d6aaf33049b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.965671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82025ad777a43b4a76d6aaf33049b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.973236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6f2daa61-1c7a-420e-beab-83701e972abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82025ad777a43b4a76d6aaf33049b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:37.979048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1175/2368] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:37 2022] DELETE /identity/v3/users/e82025ad777a43b4a76d6aaf33049b50 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:38.566270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:38.568069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:38.582562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5fb1b-a9d0-4365-8adb-b2562f3d8bbf admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:38.652590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:38.656284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:38.656808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:38.657253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] PATH_INFO: `/v3/projects/cf8da7451d3144d4b26f9d0aad0a4643` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:38.659049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8da7451d3144d4b26f9d0aad0a4643)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:38.661559 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:38.818612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8da7451d3144d4b26f9d0aad0a4643', 'request_id': 'req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:38.934545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8da7451d3144d4b26f9d0aad0a4643', 'request_id': 'req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:38.944578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8da7451d3144d4b26f9d0aad0a4643', 'request_id': 'req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:38.956377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] The token cache is being invalidate because project cf8da7451d3144d4b26f9d0aad0a4643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:38.963697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:38.963697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6e42b2e5-3ae1-46fa-92b2-2eac2dcf336b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:38.963697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1194/2369] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:38 2022] DELETE /identity/v3/projects/cf8da7451d3144d4b26f9d0aad0a4643 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:38.967695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837684-23b3-4b44-848a-0d9586f162d6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:38.968188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837684-23b3-4b44-848a-0d9586f162d6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:38.968443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837684-23b3-4b44-848a-0d9586f162d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:38.990946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8c837684-23b3-4b44-848a-0d9586f162d6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:38.993763 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8c837684-23b3-4b44-848a-0d9586f162d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:39.009887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:39.062290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1176/2370] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:39.070836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e806-c640-42e0-bb94-1aee4eed4734 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.071146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e806-c640-42e0-bb94-1aee4eed4734 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.071400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e806-c640-42e0-bb94-1aee4eed4734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.093912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ad10e806-c640-42e0-bb94-1aee4eed4734 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:39.093912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ad10e806-c640-42e0-bb94-1aee4eed4734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:39.106323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1195/2371] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:39.109676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837684-23b3-4b44-848a-0d9586f162d6 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:39.123359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837684-23b3-4b44-848a-0d9586f162d6 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:39.128328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac432e-98bb-4b75-98a8-750364cf6f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:39.128953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac432e-98bb-4b75-98a8-750364cf6f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.129238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac432e-98bb-4b75-98a8-750364cf6f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.129513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac432e-98bb-4b75-98a8-750364cf6f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.130173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac432e-98bb-4b75-98a8-750364cf6f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:23:39.130477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac432e-98bb-4b75-98a8-750364cf6f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:39.132629 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac432e-98bb-4b75-98a8-750364cf6f4d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:39.145530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1177/2372] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:23:39.150167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10e806-c640-42e0-bb94-1aee4eed4734 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:39.160235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10e806-c640-42e0-bb94-1aee4eed4734 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:39.165107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d80ec-ac01-4ddb-9be3-67cd290c39a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:39.165724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d80ec-ac01-4ddb-9be3-67cd290c39a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.166001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d80ec-ac01-4ddb-9be3-67cd290c39a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.166273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d80ec-ac01-4ddb-9be3-67cd290c39a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.166945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d80ec-ac01-4ddb-9be3-67cd290c39a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:39.168852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d80ec-ac01-4ddb-9be3-67cd290c39a1 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:39.268302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1196/2373] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:39 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:39.272565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac432e-98bb-4b75-98a8-750364cf6f4d admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:39.286489 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac432e-98bb-4b75-98a8-750364cf6f4d admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:39.344145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70472c9-2d85-4415-bee1-5c250524c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:39.347121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70472c9-2d85-4415-bee1-5c250524c05c admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.347486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70472c9-2d85-4415-bee1-5c250524c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.347795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70472c9-2d85-4415-bee1-5c250524c05c admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.348458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70472c9-2d85-4415-bee1-5c250524c05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:39.350566 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70472c9-2d85-4415-bee1-5c250524c05c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:39.428763 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1178/2374] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:39 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:39.433170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d80ec-ac01-4ddb-9be3-67cd290c39a1 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:39.444146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d80ec-ac01-4ddb-9be3-67cd290c39a1 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:39.448801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c1467-0698-4388-9327-c16a7bdca2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:39.449418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c1467-0698-4388-9327-c16a7bdca2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.449695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c1467-0698-4388-9327-c16a7bdca2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.449969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c1467-0698-4388-9327-c16a7bdca2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.450650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c1467-0698-4388-9327-c16a7bdca2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:39.452300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c1467-0698-4388-9327-c16a7bdca2d3 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:39.463956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1197/2375] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:39.471529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70472c9-2d85-4415-bee1-5c250524c05c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:39.481984 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70472c9-2d85-4415-bee1-5c250524c05c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:39.487505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde5d7c-6bd0-4a7e-8b56-cd416bdf77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:39.488159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde5d7c-6bd0-4a7e-8b56-cd416bdf77b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.488445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde5d7c-6bd0-4a7e-8b56-cd416bdf77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.488719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde5d7c-6bd0-4a7e-8b56-cd416bdf77b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.489430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde5d7c-6bd0-4a7e-8b56-cd416bdf77b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:39.491071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde5d7c-6bd0-4a7e-8b56-cd416bdf77b2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:39.502893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1179/2376] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:39.507810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c1467-0698-4388-9327-c16a7bdca2d3 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:39.515859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:39.519704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c1467-0698-4388-9327-c16a7bdca2d3 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:39.524572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11037c1a-eeac-4f95-8a99-9ebd43e1f2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:39.525733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037c1a-eeac-4f95-8a99-9ebd43e1f2ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.525733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037c1a-eeac-4f95-8a99-9ebd43e1f2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.525955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037c1a-eeac-4f95-8a99-9ebd43e1f2ad admin admin] PATH_INFO: `/v3/projects/30088814d9ff402e83642a5d10e79c97/users/4c4e1c94ed994ec089589d89a374ca9e/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.541037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11037c1a-eeac-4f95-8a99-9ebd43e1f2ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=30088814d9ff402e83642a5d10e79c97, user_id=4c4e1c94ed994ec089589d89a374ca9e, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:39.544062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11037c1a-eeac-4f95-8a99-9ebd43e1f2ad admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:39.643789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1198/2377] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:39 2022] PUT /identity/v3/projects/30088814d9ff402e83642a5d10e79c97/users/4c4e1c94ed994ec089589d89a374ca9e/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:39.649961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e74c9-7440-4b4f-91fa-726e77d39a03 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.650259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e74c9-7440-4b4f-91fa-726e77d39a03 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.650542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e74c9-7440-4b4f-91fa-726e77d39a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.683886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11037c1a-eeac-4f95-8a99-9ebd43e1f2ad admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:39.686136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-11037c1a-eeac-4f95-8a99-9ebd43e1f2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:39.688785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-2c0e74c9-7440-4b4f-91fa-726e77d39a03 None None] MFA Rules not processed for user `4c4e1c94ed994ec089589d89a374ca9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:39.693057 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2c0e74c9-7440-4b4f-91fa-726e77d39a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:39.788862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1180/2378] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:39.793221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e74c9-7440-4b4f-91fa-726e77d39a03 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:39.814388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11037c1a-eeac-4f95-8a99-9ebd43e1f2ad admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:39.818361 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:39.826956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ec3c0-7462-4448-a826-c279897ec8c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:39.828577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ec3c0-7462-4448-a826-c279897ec8c6 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.828937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ec3c0-7462-4448-a826-c279897ec8c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.829297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ec3c0-7462-4448-a826-c279897ec8c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.831749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-083ec3c0-7462-4448-a826-c279897ec8c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:39.850519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ec3c0-7462-4448-a826-c279897ec8c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:39.852481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ec3c0-7462-4448-a826-c279897ec8c6 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:39.866159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1199/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:23:39.900924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e74c9-7440-4b4f-91fa-726e77d39a03 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:39.912078 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b92fd-4c3c-4e75-91fe-3725f37bfd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:39.912719 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b92fd-4c3c-4e75-91fe-3725f37bfd8a admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:39.913007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b92fd-4c3c-4e75-91fe-3725f37bfd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:39.913288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b92fd-4c3c-4e75-91fe-3725f37bfd8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:39.913936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b92fd-4c3c-4e75-91fe-3725f37bfd8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:39.917751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b92fd-4c3c-4e75-91fe-3725f37bfd8a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:40.030076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1181/2380] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:39 2022] POST /identity/v3/projects => generated 393 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:40.033911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ec3c0-7462-4448-a826-c279897ec8c6 service nova] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:40.051097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ec3c0-7462-4448-a826-c279897ec8c6 service nova] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:40.132422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05a42b-6504-4389-9abd-82ac6dd1cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:40.133133 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a42b-6504-4389-9abd-82ac6dd1cddd admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:40.133384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a42b-6504-4389-9abd-82ac6dd1cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:40.134170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a42b-6504-4389-9abd-82ac6dd1cddd admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:40.134303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05a42b-6504-4389-9abd-82ac6dd1cddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:40.136196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05a42b-6504-4389-9abd-82ac6dd1cddd admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:40.267028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1200/2381] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:40 2022] POST /identity/v3/users => generated 303 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:40.268766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b92fd-4c3c-4e75-91fe-3725f37bfd8a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:40.280441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b92fd-4c3c-4e75-91fe-3725f37bfd8a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:40.287376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd901d-e899-4d64-be53-d754de293f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:40.287967 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd901d-e899-4d64-be53-d754de293f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:40.288720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd901d-e899-4d64-be53-d754de293f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:40.288720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd901d-e899-4d64-be53-d754de293f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:40.289319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd901d-e899-4d64-be53-d754de293f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:40.298976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd901d-e899-4d64-be53-d754de293f6f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:40.309670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1182/2382] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:40.314358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05a42b-6504-4389-9abd-82ac6dd1cddd admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:40.325281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05a42b-6504-4389-9abd-82ac6dd1cddd admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:40.331846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecee1c4-9880-47a1-88d3-74598a278c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:40.332530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecee1c4-9880-47a1-88d3-74598a278c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:40.333320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecee1c4-9880-47a1-88d3-74598a278c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:40.333320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecee1c4-9880-47a1-88d3-74598a278c3d admin admin] PATH_INFO: `/v3/projects/a3a89bf3201f45bc9336070c2130a3c7/users/1ff502924f2949f1b214c811e174e2c5/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:40.349652 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecee1c4-9880-47a1-88d3-74598a278c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a89bf3201f45bc9336070c2130a3c7, user_id=1ff502924f2949f1b214c811e174e2c5, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:40.352319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecee1c4-9880-47a1-88d3-74598a278c3d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:40.462025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1201/2383] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:40 2022] PUT /identity/v3/projects/a3a89bf3201f45bc9336070c2130a3c7/users/1ff502924f2949f1b214c811e174e2c5/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:40.466177 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd901d-e899-4d64-be53-d754de293f6f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:40.476717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd901d-e899-4d64-be53-d754de293f6f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:40.541303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316e5a7-e628-4e9c-bc5c-e29d5750febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:40.541931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316e5a7-e628-4e9c-bc5c-e29d5750febb admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:40.542216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316e5a7-e628-4e9c-bc5c-e29d5750febb admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:40.542514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316e5a7-e628-4e9c-bc5c-e29d5750febb admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:40.543191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316e5a7-e628-4e9c-bc5c-e29d5750febb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:40.544941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316e5a7-e628-4e9c-bc5c-e29d5750febb admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:40.555338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1183/2384] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:40.559503 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecee1c4-9880-47a1-88d3-74598a278c3d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:40.571101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecee1c4-9880-47a1-88d3-74598a278c3d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:40.575971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4ff3c-9a4f-4898-a528-f2d548d83c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:40.576806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4ff3c-9a4f-4898-a528-f2d548d83c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:40.577160 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4ff3c-9a4f-4898-a528-f2d548d83c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:40.584756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4ff3c-9a4f-4898-a528-f2d548d83c7f admin admin] PATH_INFO: `/v3/projects/a3a89bf3201f45bc9336070c2130a3c7/users/1ff502924f2949f1b214c811e174e2c5/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:40.588542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4ff3c-9a4f-4898-a528-f2d548d83c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a89bf3201f45bc9336070c2130a3c7, user_id=1ff502924f2949f1b214c811e174e2c5, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:40.591191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4ff3c-9a4f-4898-a528-f2d548d83c7f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:40.609238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1202/2385] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:40 2022] PUT /identity/v3/projects/a3a89bf3201f45bc9336070c2130a3c7/users/1ff502924f2949f1b214c811e174e2c5/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:40.616497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595cb5-2e23-4c9e-9852-315bb714b346 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:40.616731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595cb5-2e23-4c9e-9852-315bb714b346 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:40.617009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595cb5-2e23-4c9e-9852-315bb714b346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:40.662101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-74595cb5-2e23-4c9e-9852-315bb714b346 None None] MFA Rules not processed for user `1ff502924f2949f1b214c811e174e2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:40.663351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-74595cb5-2e23-4c9e-9852-315bb714b346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:40.763861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1184/2386] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:40.777259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4ff3c-9a4f-4898-a528-f2d548d83c7f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:40.779369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-93a4ff3c-9a4f-4898-a528-f2d548d83c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:40.803444 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:40.849905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4ff3c-9a4f-4898-a528-f2d548d83c7f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:40.854006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01335f-e1e0-49b9-b35c-71f692632bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:40.854614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01335f-e1e0-49b9-b35c-71f692632bbe service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:40.854895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01335f-e1e0-49b9-b35c-71f692632bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:40.855172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01335f-e1e0-49b9-b35c-71f692632bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:40.865908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01335f-e1e0-49b9-b35c-71f692632bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:40.867388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01335f-e1e0-49b9-b35c-71f692632bbe service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:40.878096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1203/2387] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:40.925996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595cb5-2e23-4c9e-9852-315bb714b346 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:40.927372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-74595cb5-2e23-4c9e-9852-315bb714b346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:40.939109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595cb5-2e23-4c9e-9852-315bb714b346 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:40.943416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ced814-2e6e-4934-b9a8-ad4acc702651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:40.944120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ced814-2e6e-4934-b9a8-ad4acc702651 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:40.944437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ced814-2e6e-4934-b9a8-ad4acc702651 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:40.944618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ced814-2e6e-4934-b9a8-ad4acc702651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:40.953336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:41.002786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ced814-2e6e-4934-b9a8-ad4acc702651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:41.004274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ced814-2e6e-4934-b9a8-ad4acc702651 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:41.014171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1185/2388] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:45.780438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01335f-e1e0-49b9-b35c-71f692632bbe service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:45.847816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01335f-e1e0-49b9-b35c-71f692632bbe service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:45.852510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:45.853154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:45.853435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:45.853715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] PATH_INFO: `/v3/users/4c4e1c94ed994ec089589d89a374ca9e` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:45.854849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4e1c94ed994ec089589d89a374ca9e)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:45.856798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:46.051765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4e1c94ed994ec089589d89a374ca9e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:46.052433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4e1c94ed994ec089589d89a374ca9e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:46.134539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4e1c94ed994ec089589d89a374ca9e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:46.135168 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4e1c94ed994ec089589d89a374ca9e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:46.143496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4e1c94ed994ec089589d89a374ca9e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:46.162103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1204/2389] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:45 2022] DELETE /identity/v3/users/4c4e1c94ed994ec089589d89a374ca9e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:46.167389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154139b-5889-4e32-9447-05bcfcbbce2c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:46.167879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154139b-5889-4e32-9447-05bcfcbbce2c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:46.167973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154139b-5889-4e32-9447-05bcfcbbce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:46.188159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8154139b-5889-4e32-9447-05bcfcbbce2c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:46.189425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8154139b-5889-4e32-9447-05bcfcbbce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:46.247274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1186/2390] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:46.257210 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:46.258650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:46.307480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:46.321196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3bbae-a741-40b8-b8a1-1cc105700770 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:46.324930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6d4e-97d5-446c-9948-b4c97732ae05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:46.325540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6d4e-97d5-446c-9948-b4c97732ae05 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:46.325820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6d4e-97d5-446c-9948-b4c97732ae05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:46.326094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6d4e-97d5-446c-9948-b4c97732ae05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:46.335887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf6d4e-97d5-446c-9948-b4c97732ae05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:46.337379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf6d4e-97d5-446c-9948-b4c97732ae05 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:46.348780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1205/2391] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:46.421978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154139b-5889-4e32-9447-05bcfcbbce2c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:46.434075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154139b-5889-4e32-9447-05bcfcbbce2c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:46.438215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0efa7-6b6c-41bb-af83-96ed4483c07a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:46.438826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0efa7-6b6c-41bb-af83-96ed4483c07a service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:46.439109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0efa7-6b6c-41bb-af83-96ed4483c07a service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:46.439384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0efa7-6b6c-41bb-af83-96ed4483c07a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:46.442122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-08e0efa7-6b6c-41bb-af83-96ed4483c07a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:46.454515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0efa7-6b6c-41bb-af83-96ed4483c07a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:46.456283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0efa7-6b6c-41bb-af83-96ed4483c07a service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:46.466201 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1187/2392] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:46.821006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6d4e-97d5-446c-9948-b4c97732ae05 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:46.822957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-14cf6d4e-97d5-446c-9948-b4c97732ae05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:46.837654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6d4e-97d5-446c-9948-b4c97732ae05 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:46.842771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:46.843548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:46.843883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:46.844218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] PATH_INFO: `/v3/projects/30088814d9ff402e83642a5d10e79c97` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:46.845415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30088814d9ff402e83642a5d10e79c97)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:46.848264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:46.958408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30088814d9ff402e83642a5d10e79c97', 'request_id': 'req-a222a849-7434-4ddc-96d5-9a04fa83a163'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.060093 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30088814d9ff402e83642a5d10e79c97', 'request_id': 'req-a222a849-7434-4ddc-96d5-9a04fa83a163'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.067011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30088814d9ff402e83642a5d10e79c97', 'request_id': 'req-a222a849-7434-4ddc-96d5-9a04fa83a163'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.079341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] The token cache is being invalidate because project 30088814d9ff402e83642a5d10e79c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:47.085240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.085240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.085240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1206/2393] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:46 2022] DELETE /identity/v3/projects/30088814d9ff402e83642a5d10e79c97 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:47.086286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0efa7-6b6c-41bb-af83-96ed4483c07a service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:47.096422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0efa7-6b6c-41bb-af83-96ed4483c07a service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:47.160413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:47.161104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:47.161385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:47.161662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] PATH_INFO: `/v3/users/1ff502924f2949f1b214c811e174e2c5` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:47.162902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff502924f2949f1b214c811e174e2c5)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:47.164919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:47.386467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:47.405666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff502924f2949f1b214c811e174e2c5'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.477155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff502924f2949f1b214c811e174e2c5'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.492649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff502924f2949f1b214c811e174e2c5'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.493804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff502924f2949f1b214c811e174e2c5'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.510109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-a88f00e2-3271-48c7-862d-3f32919c03c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff502924f2949f1b214c811e174e2c5'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:47.517342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1188/2394] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:47 2022] DELETE /identity/v3/users/1ff502924f2949f1b214c811e174e2c5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:48.044772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:48.050679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:48.059535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222a849-7434-4ddc-96d5-9a04fa83a163 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:48.150537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:48.151484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:48.151796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:48.152074 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] PATH_INFO: `/v3/projects/a3a89bf3201f45bc9336070c2130a3c7` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:48.153346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a89bf3201f45bc9336070c2130a3c7)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:48.155247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:48.282895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a89bf3201f45bc9336070c2130a3c7', 'request_id': 'req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:48.381624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a89bf3201f45bc9336070c2130a3c7', 'request_id': 'req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:48.389733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a89bf3201f45bc9336070c2130a3c7', 'request_id': 'req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:48.395476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:48.401797 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] The token cache is being invalidate because project a3a89bf3201f45bc9336070c2130a3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:48.402171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:48.402838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2ab72183-b18f-4ca1-8a2f-8b0c4ad72ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:48.404337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1207/2395] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:48 2022] DELETE /identity/v3/projects/a3a89bf3201f45bc9336070c2130a3c7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:48.409215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b4855-8702-4627-98d5-167d07e9b104 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:48.409735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b4855-8702-4627-98d5-167d07e9b104 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:48.409883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b4855-8702-4627-98d5-167d07e9b104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:48.430652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-604b4855-8702-4627-98d5-167d07e9b104 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:48.432009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-604b4855-8702-4627-98d5-167d07e9b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:48.497800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1189/2396] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:48.506468 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3a66f-dac7-47de-81ae-aede92bebf64 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:48.506817 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3a66f-dac7-47de-81ae-aede92bebf64 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:48.507103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3a66f-dac7-47de-81ae-aede92bebf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:48.528017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-94a3a66f-dac7-47de-81ae-aede92bebf64 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:48.529506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-94a3a66f-dac7-47de-81ae-aede92bebf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:48.537487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1208/2397] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:23:48.541980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b4855-8702-4627-98d5-167d07e9b104 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:48.552640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b4855-8702-4627-98d5-167d07e9b104 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:48.557384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04130d-8750-4b38-81c6-ddef3ffe65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:48.558000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04130d-8750-4b38-81c6-ddef3ffe65e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:48.558320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04130d-8750-4b38-81c6-ddef3ffe65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:48.558588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04130d-8750-4b38-81c6-ddef3ffe65e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:48.559240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04130d-8750-4b38-81c6-ddef3ffe65e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:23:48.559542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04130d-8750-4b38-81c6-ddef3ffe65e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:48.561232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04130d-8750-4b38-81c6-ddef3ffe65e7 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:48.574223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1190/2398] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:23:48.585450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3a66f-dac7-47de-81ae-aede92bebf64 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:48.594631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3a66f-dac7-47de-81ae-aede92bebf64 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:48.601389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0624d3-3f22-4616-a5ab-24d6d6ecfee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:48.602240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0624d3-3f22-4616-a5ab-24d6d6ecfee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:48.603058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0624d3-3f22-4616-a5ab-24d6d6ecfee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:48.603058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0624d3-3f22-4616-a5ab-24d6d6ecfee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:48.603791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0624d3-3f22-4616-a5ab-24d6d6ecfee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:48.605862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0624d3-3f22-4616-a5ab-24d6d6ecfee1 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:48.715601 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1209/2399] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:48 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:48.717138 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04130d-8750-4b38-81c6-ddef3ffe65e7 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:48.731099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04130d-8750-4b38-81c6-ddef3ffe65e7 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:48.799774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bd231-2e2e-4dc8-956d-0f69457890ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:48.802495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bd231-2e2e-4dc8-956d-0f69457890ae admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:48.802884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bd231-2e2e-4dc8-956d-0f69457890ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:48.803377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bd231-2e2e-4dc8-956d-0f69457890ae admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:48.804283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bd231-2e2e-4dc8-956d-0f69457890ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:48.806482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bd231-2e2e-4dc8-956d-0f69457890ae admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:48.897465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1191/2400] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:48 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:23:48.910923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0624d3-3f22-4616-a5ab-24d6d6ecfee1 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:48.923478 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0624d3-3f22-4616-a5ab-24d6d6ecfee1 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:48.929320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cdbce-a640-4f65-b772-6860867eb17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:48.930194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cdbce-a640-4f65-b772-6860867eb17e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:48.930623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cdbce-a640-4f65-b772-6860867eb17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:48.931081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cdbce-a640-4f65-b772-6860867eb17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:48.932178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cdbce-a640-4f65-b772-6860867eb17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:48.933816 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cdbce-a640-4f65-b772-6860867eb17e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:48.953153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1210/2401] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:48.955443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bd231-2e2e-4dc8-956d-0f69457890ae admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:48.970049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bd231-2e2e-4dc8-956d-0f69457890ae admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:48.975217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be0f1e-514e-413c-b477-dae06cc94084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:48.975861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be0f1e-514e-413c-b477-dae06cc94084 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:48.976142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be0f1e-514e-413c-b477-dae06cc94084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:48.976434 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be0f1e-514e-413c-b477-dae06cc94084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:48.977101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be0f1e-514e-413c-b477-dae06cc94084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:48.978701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be0f1e-514e-413c-b477-dae06cc94084 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:48.990675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1192/2402] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:48.997568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cdbce-a640-4f65-b772-6860867eb17e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:49.008619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cdbce-a640-4f65-b772-6860867eb17e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:49.013131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010f705-07cd-4b3b-8814-4fd53f526d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:49.013872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010f705-07cd-4b3b-8814-4fd53f526d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:49.014229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010f705-07cd-4b3b-8814-4fd53f526d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:49.014577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010f705-07cd-4b3b-8814-4fd53f526d70 admin admin] PATH_INFO: `/v3/projects/99462c2b81c545519c2f9d2d6d312135/users/ee63cb1d8f2845c2bc171faa38c99aee/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:49.030294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010f705-07cd-4b3b-8814-4fd53f526d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99462c2b81c545519c2f9d2d6d312135, user_id=ee63cb1d8f2845c2bc171faa38c99aee, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:49.033070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010f705-07cd-4b3b-8814-4fd53f526d70 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:49.106698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1211/2403] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:48 2022] PUT /identity/v3/projects/99462c2b81c545519c2f9d2d6d312135/users/ee63cb1d8f2845c2bc171faa38c99aee/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:49.114147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42084238-d112-4e75-b51f-0d8f00170fa4 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:49.114147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42084238-d112-4e75-b51f-0d8f00170fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:49.114147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42084238-d112-4e75-b51f-0d8f00170fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:49.139246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-42084238-d112-4e75-b51f-0d8f00170fa4 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:49.140453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-42084238-d112-4e75-b51f-0d8f00170fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:49.159977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:49.214422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1193/2404] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:49.231598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010f705-07cd-4b3b-8814-4fd53f526d70 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:49.233493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1010f705-07cd-4b3b-8814-4fd53f526d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:49.317005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010f705-07cd-4b3b-8814-4fd53f526d70 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:49.322325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55525730-4236-454d-bcef-f0f4641820a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:49.323041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55525730-4236-454d-bcef-f0f4641820a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:49.323396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55525730-4236-454d-bcef-f0f4641820a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:49.323778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55525730-4236-454d-bcef-f0f4641820a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:49.338120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55525730-4236-454d-bcef-f0f4641820a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:49.339567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55525730-4236-454d-bcef-f0f4641820a4 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:49.352260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1212/2405] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:51.067990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116b16-ae19-4544-822c-b23f960fef41 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:51.068582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116b16-ae19-4544-822c-b23f960fef41 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:51.068582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116b16-ae19-4544-822c-b23f960fef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:51.102458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-40116b16-ae19-4544-822c-b23f960fef41 None None] MFA Rules not processed for user `ee63cb1d8f2845c2bc171faa38c99aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:51.103721 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-40116b16-ae19-4544-822c-b23f960fef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:51.203275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1194/2406] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:51.208561 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55525730-4236-454d-bcef-f0f4641820a4 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:51.221144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55525730-4236-454d-bcef-f0f4641820a4 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:51.243084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80bb33-e8b7-4dee-b2ae-dc80bd36e188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:51.244011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80bb33-e8b7-4dee-b2ae-dc80bd36e188 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:51.244474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80bb33-e8b7-4dee-b2ae-dc80bd36e188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:51.244903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80bb33-e8b7-4dee-b2ae-dc80bd36e188 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:51.246310 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80bb33-e8b7-4dee-b2ae-dc80bd36e188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:51.249525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80bb33-e8b7-4dee-b2ae-dc80bd36e188 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:51.271410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40116b16-ae19-4544-822c-b23f960fef41 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:51.272714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-40116b16-ae19-4544-822c-b23f960fef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:51.343574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1213/2407] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:51 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:51.348589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80bb33-e8b7-4dee-b2ae-dc80bd36e188 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:51.364706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40116b16-ae19-4544-822c-b23f960fef41 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:51.420765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80bb33-e8b7-4dee-b2ae-dc80bd36e188 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:51.430460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:51.434424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210efbd3-be74-4488-92d2-e0f9f83a2cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:51.435122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210efbd3-be74-4488-92d2-e0f9f83a2cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:51.435471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210efbd3-be74-4488-92d2-e0f9f83a2cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:51.435898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210efbd3-be74-4488-92d2-e0f9f83a2cbf admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:51.436633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210efbd3-be74-4488-92d2-e0f9f83a2cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:51.438657 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210efbd3-be74-4488-92d2-e0f9f83a2cbf admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:51.445437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:51.446063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:51.446391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:51.446672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:51.449464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:51.461395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:51.462962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:51.473422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1195/2408] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:23:51.474224 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:51.475840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:51.490780 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67f08e-ac53-4f5a-846e-358cece6756f service placement] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:51.495344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:51.496050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:51.496333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:51.496608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] PATH_INFO: `/v3/users/504c97036895408b9e04deb0792d5576` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:51.497771 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=504c97036895408b9e04deb0792d5576)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:51.499917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:51.544509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1214/2409] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:51 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:23:51.549318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210efbd3-be74-4488-92d2-e0f9f83a2cbf admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:51.555261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:51.560472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210efbd3-be74-4488-92d2-e0f9f83a2cbf admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:51.565978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71147bb4-c65e-4e7c-948b-87a7d5ad1623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:51.566567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71147bb4-c65e-4e7c-948b-87a7d5ad1623 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:51.566888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71147bb4-c65e-4e7c-948b-87a7d5ad1623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:51.567162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71147bb4-c65e-4e7c-948b-87a7d5ad1623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:51.567825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71147bb4-c65e-4e7c-948b-87a7d5ad1623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:51.569389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71147bb4-c65e-4e7c-948b-87a7d5ad1623 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:51.579893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1215/2410] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:23:51.585025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71147bb4-c65e-4e7c-948b-87a7d5ad1623 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:51.594751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71147bb4-c65e-4e7c-948b-87a7d5ad1623 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:51.599811 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9f5e-a36d-4eaa-9cc5-34312c390fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:51.600441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9f5e-a36d-4eaa-9cc5-34312c390fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:51.600717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9f5e-a36d-4eaa-9cc5-34312c390fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:51.601033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9f5e-a36d-4eaa-9cc5-34312c390fe7 admin admin] PATH_INFO: `/v3/projects/0a8000e71d084e408860a400873ac8d6/users/99cc8da91d4044daacd4df60bcf80750/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:51.616662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9f5e-a36d-4eaa-9cc5-34312c390fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8000e71d084e408860a400873ac8d6, user_id=99cc8da91d4044daacd4df60bcf80750, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:51.619264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9f5e-a36d-4eaa-9cc5-34312c390fe7 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:51.702315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504c97036895408b9e04deb0792d5576'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:51.717348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1216/2411] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:51 2022] PUT /identity/v3/projects/0a8000e71d084e408860a400873ac8d6/users/99cc8da91d4044daacd4df60bcf80750/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:23:51.721479 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9f5e-a36d-4eaa-9cc5-34312c390fe7 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:51.756915 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504c97036895408b9e04deb0792d5576'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:51.770694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504c97036895408b9e04deb0792d5576'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:51.771420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504c97036895408b9e04deb0792d5576'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:51.779119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504c97036895408b9e04deb0792d5576'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:51.782906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9f5e-a36d-4eaa-9cc5-34312c390fe7 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:51.786477 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1196/2412] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:51 2022] DELETE /identity/v3/users/504c97036895408b9e04deb0792d5576 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:51.788452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea9f9-7b67-4977-abfc-c1e5abc6a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:51.789071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea9f9-7b67-4977-abfc-c1e5abc6a389 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:51.789429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea9f9-7b67-4977-abfc-c1e5abc6a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:51.790281 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea9f9-7b67-4977-abfc-c1e5abc6a389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:51.790391 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea9f9-7b67-4977-abfc-c1e5abc6a389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:51.792017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea9f9-7b67-4977-abfc-c1e5abc6a389 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:51.805678 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1217/2413] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:23:51.807371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:51.808986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:51.878352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfa885-ed51-4b38-b90b-1a759a63c0f0 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:51.883072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3bfd2-ea2b-437a-936d-5935d0bff357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:51.884609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3bfd2-ea2b-437a-936d-5935d0bff357 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:51.884609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3bfd2-ea2b-437a-936d-5935d0bff357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:51.884609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3bfd2-ea2b-437a-936d-5935d0bff357 admin admin] PATH_INFO: `/v3/projects/0a8000e71d084e408860a400873ac8d6/users/99cc8da91d4044daacd4df60bcf80750/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:51.886193 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3bfd2-ea2b-437a-936d-5935d0bff357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8000e71d084e408860a400873ac8d6, user_id=99cc8da91d4044daacd4df60bcf80750, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:51.889312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3bfd2-ea2b-437a-936d-5935d0bff357 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:51.900551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1197/2414] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:51 2022] PUT /identity/v3/projects/0a8000e71d084e408860a400873ac8d6/users/99cc8da91d4044daacd4df60bcf80750/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:52.052011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea9f9-7b67-4977-abfc-c1e5abc6a389 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:52.053800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d39ea9f9-7b67-4977-abfc-c1e5abc6a389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:52.067058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea9f9-7b67-4977-abfc-c1e5abc6a389 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:52.140815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:52.141800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:52.141800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:52.142022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] PATH_INFO: `/v3/projects/c26f3b568b0645a79572ac4b973903db` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:52.143164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26f3b568b0645a79572ac4b973903db)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:52.145631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:52.264458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26f3b568b0645a79572ac4b973903db', 'request_id': 'req-95dc6982-4940-474d-88c5-9ef5b2d34a80'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:52.351653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26f3b568b0645a79572ac4b973903db', 'request_id': 'req-95dc6982-4940-474d-88c5-9ef5b2d34a80'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:52.358494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26f3b568b0645a79572ac4b973903db', 'request_id': 'req-95dc6982-4940-474d-88c5-9ef5b2d34a80'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:52.362640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:52.369632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] The token cache is being invalidate because project c26f3b568b0645a79572ac4b973903db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:23:52.369920 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:52.370564 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-95dc6982-4940-474d-88c5-9ef5b2d34a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:52.372215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1218/2415] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:23:52 2022] DELETE /identity/v3/projects/c26f3b568b0645a79572ac4b973903db => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:52.377300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c67773-51da-4d12-a0ee-a077ae4640b6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:52.377825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c67773-51da-4d12-a0ee-a077ae4640b6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:52.377924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c67773-51da-4d12-a0ee-a077ae4640b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:52.399663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-f3c67773-51da-4d12-a0ee-a077ae4640b6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:52.401027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-f3c67773-51da-4d12-a0ee-a077ae4640b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:52.450559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:52.465906 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1198/2416] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:23:52.473901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5124e-0c39-4b06-aacc-57b91b2d326e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:52.474266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5124e-0c39-4b06-aacc-57b91b2d326e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:52.474552 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5124e-0c39-4b06-aacc-57b91b2d326e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:52.498429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-45d5124e-0c39-4b06-aacc-57b91b2d326e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:52.499529 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-45d5124e-0c39-4b06-aacc-57b91b2d326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:52.508979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1219/2417] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:52.512979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c67773-51da-4d12-a0ee-a077ae4640b6 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:52.523337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c67773-51da-4d12-a0ee-a077ae4640b6 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:52.528296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed4ec-7168-4226-b423-00b96d9912e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:52.528926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed4ec-7168-4226-b423-00b96d9912e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:52.529217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed4ec-7168-4226-b423-00b96d9912e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:52.529478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed4ec-7168-4226-b423-00b96d9912e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:52.530136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed4ec-7168-4226-b423-00b96d9912e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:23:52.530442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed4ec-7168-4226-b423-00b96d9912e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:52.532302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed4ec-7168-4226-b423-00b96d9912e8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:52.544749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1199/2418] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:23:52.550488 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5124e-0c39-4b06-aacc-57b91b2d326e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:52.560459 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5124e-0c39-4b06-aacc-57b91b2d326e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:52.565462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807fa9-ea34-49c1-9fed-c10692f04e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:52.566815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807fa9-ea34-49c1-9fed-c10692f04e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:52.567098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807fa9-ea34-49c1-9fed-c10692f04e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:52.567547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807fa9-ea34-49c1-9fed-c10692f04e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:52.568192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1807fa9-ea34-49c1-9fed-c10692f04e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:52.570253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1807fa9-ea34-49c1-9fed-c10692f04e0e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:52.698214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1220/2419] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:52 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:52.703087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed4ec-7168-4226-b423-00b96d9912e8 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:52.714170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed4ec-7168-4226-b423-00b96d9912e8 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:52.778938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19cab-3bb0-45c9-85b4-fbefc2589331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:52.779544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19cab-3bb0-45c9-85b4-fbefc2589331 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:52.779871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19cab-3bb0-45c9-85b4-fbefc2589331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:52.780143 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19cab-3bb0-45c9-85b4-fbefc2589331 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:52.780773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19cab-3bb0-45c9-85b4-fbefc2589331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:52.782902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19cab-3bb0-45c9-85b4-fbefc2589331 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:52.922809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1200/2420] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:52 2022] POST /identity/v3/users => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:52.927675 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807fa9-ea34-49c1-9fed-c10692f04e0e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:52.938083 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807fa9-ea34-49c1-9fed-c10692f04e0e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:52.942611 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13af6-ad5c-4f51-8c76-059c91dca8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:52.943290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13af6-ad5c-4f51-8c76-059c91dca8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:52.943571 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13af6-ad5c-4f51-8c76-059c91dca8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:52.944020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13af6-ad5c-4f51-8c76-059c91dca8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:52.944717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c13af6-ad5c-4f51-8c76-059c91dca8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:52.946330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c13af6-ad5c-4f51-8c76-059c91dca8fc admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:52.964579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1221/2421] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:52.968919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19cab-3bb0-45c9-85b4-fbefc2589331 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:52.979527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19cab-3bb0-45c9-85b4-fbefc2589331 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:52.984580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1f0fd-7102-49f5-91de-0ae3637024dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:52.989366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1f0fd-7102-49f5-91de-0ae3637024dc admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:52.989366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1f0fd-7102-49f5-91de-0ae3637024dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:52.989366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1f0fd-7102-49f5-91de-0ae3637024dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:52.989366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1f0fd-7102-49f5-91de-0ae3637024dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:52.989366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1f0fd-7102-49f5-91de-0ae3637024dc admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:52.999402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1201/2422] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:53.003874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13af6-ad5c-4f51-8c76-059c91dca8fc admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:53.013748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13af6-ad5c-4f51-8c76-059c91dca8fc admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:53.018304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392c25c-2333-4d89-a25a-542540d5623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:53.018943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392c25c-2333-4d89-a25a-542540d5623c admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.019228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392c25c-2333-4d89-a25a-542540d5623c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.019507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392c25c-2333-4d89-a25a-542540d5623c admin admin] PATH_INFO: `/v3/projects/c9ea2bbcf5584c2595651e214321e367/users/3196f8bf7a854946acff9b17d5ab6ad4/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.034227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392c25c-2333-4d89-a25a-542540d5623c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ea2bbcf5584c2595651e214321e367, user_id=3196f8bf7a854946acff9b17d5ab6ad4, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:53.037389 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392c25c-2333-4d89-a25a-542540d5623c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:53.130571 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1222/2423] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:53 2022] PUT /identity/v3/projects/c9ea2bbcf5584c2595651e214321e367/users/3196f8bf7a854946acff9b17d5ab6ad4/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:23:53.142411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47e5aa-4131-47f1-a311-fb3cd67f41c5 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.142831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47e5aa-4131-47f1-a311-fb3cd67f41c5 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.143170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47e5aa-4131-47f1-a311-fb3cd67f41c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.172751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-9f47e5aa-4131-47f1-a311-fb3cd67f41c5 None None] MFA Rules not processed for user `3196f8bf7a854946acff9b17d5ab6ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:53.173983 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9f47e5aa-4131-47f1-a311-fb3cd67f41c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:53.204348 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694005-c0c6-436b-ba55-a51b1535dd73 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.205367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694005-c0c6-436b-ba55-a51b1535dd73 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.206042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694005-c0c6-436b-ba55-a51b1535dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.246981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-10694005-c0c6-436b-ba55-a51b1535dd73 None None] MFA Rules not processed for user `99cc8da91d4044daacd4df60bcf80750`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:53.249572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-10694005-c0c6-436b-ba55-a51b1535dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:53.255798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1202/2424] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:53.256868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47e5aa-4131-47f1-a311-fb3cd67f41c5 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:53.312913 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:53.329313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47e5aa-4131-47f1-a311-fb3cd67f41c5 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:53.331098 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1223/2425] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:23:53.339577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690e033-199f-4648-8ed1-88895e4c29a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:53.340383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690e033-199f-4648-8ed1-88895e4c29a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.340729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690e033-199f-4648-8ed1-88895e4c29a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.341419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690e033-199f-4648-8ed1-88895e4c29a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.342064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690e033-199f-4648-8ed1-88895e4c29a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:53.342196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0c568-b8d1-477e-90f9-262ed80d540e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.342375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0c568-b8d1-477e-90f9-262ed80d540e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.342661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0c568-b8d1-477e-90f9-262ed80d540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.344069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690e033-199f-4648-8ed1-88895e4c29a5 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:53.362095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8ed0c568-b8d1-477e-90f9-262ed80d540e None None] MFA Rules not processed for user `ee63cb1d8f2845c2bc171faa38c99aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:53.363347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8ed0c568-b8d1-477e-90f9-262ed80d540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:53.418739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1224/2426] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:53.430336 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0c568-b8d1-477e-90f9-262ed80d540e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:53.432271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8ed0c568-b8d1-477e-90f9-262ed80d540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:53.433902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1203/2427] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:23:53 2022] POST /identity/v3/projects => generated 399 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:23:53.440043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690e033-199f-4648-8ed1-88895e4c29a5 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:53.460966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:53.506311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690e033-199f-4648-8ed1-88895e4c29a5 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:53.510997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182c568-d07c-4933-8aa8-ee800cddddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:53.511611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182c568-d07c-4933-8aa8-ee800cddddee admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.511923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182c568-d07c-4933-8aa8-ee800cddddee admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.512195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182c568-d07c-4933-8aa8-ee800cddddee admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.512841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182c568-d07c-4933-8aa8-ee800cddddee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:53.514750 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182c568-d07c-4933-8aa8-ee800cddddee admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:53.516014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0c568-b8d1-477e-90f9-262ed80d540e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:53.580288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511c608-c6d6-4470-87fa-0daabf5fb4f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:53.581159 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511c608-c6d6-4470-87fa-0daabf5fb4f4 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.581437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511c608-c6d6-4470-87fa-0daabf5fb4f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.581749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511c608-c6d6-4470-87fa-0daabf5fb4f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.583480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7511c608-c6d6-4470-87fa-0daabf5fb4f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:53.598623 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1204/2428] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:23:53 2022] POST /identity/v3/users => generated 306 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:23:53.602788 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182c568-d07c-4933-8aa8-ee800cddddee admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:53.613217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182c568-d07c-4933-8aa8-ee800cddddee admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:53.617835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16360463-92dd-4f58-a9d4-2864be553a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:53.618431 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16360463-92dd-4f58-a9d4-2864be553a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.618707 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16360463-92dd-4f58-a9d4-2864be553a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.618981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16360463-92dd-4f58-a9d4-2864be553a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.619643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16360463-92dd-4f58-a9d4-2864be553a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:53.621222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16360463-92dd-4f58-a9d4-2864be553a38 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:53.631783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1205/2429] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:23:53.637063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16360463-92dd-4f58-a9d4-2864be553a38 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:53.646668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511c608-c6d6-4470-87fa-0daabf5fb4f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:53.647271 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16360463-92dd-4f58-a9d4-2864be553a38 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:53.648302 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511c608-c6d6-4470-87fa-0daabf5fb4f4 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:53.651922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322d48e-8dab-417e-b0ad-b583abdd5803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:53.652599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322d48e-8dab-417e-b0ad-b583abdd5803 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.652879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322d48e-8dab-417e-b0ad-b583abdd5803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.653156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322d48e-8dab-417e-b0ad-b583abdd5803 admin admin] PATH_INFO: `/v3/projects/3dc50a4181c14e0689ca8d9f1da9f67f/users/f899f837d91241f3bf819460208cff20/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.657851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1225/2430] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:23:53.668785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322d48e-8dab-417e-b0ad-b583abdd5803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc50a4181c14e0689ca8d9f1da9f67f, user_id=f899f837d91241f3bf819460208cff20, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:53.671402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322d48e-8dab-417e-b0ad-b583abdd5803 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:53.780742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1206/2431] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:53 2022] PUT /identity/v3/projects/3dc50a4181c14e0689ca8d9f1da9f67f/users/f899f837d91241f3bf819460208cff20/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:23:53.785330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511c608-c6d6-4470-87fa-0daabf5fb4f4 service nova] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:53.795767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511c608-c6d6-4470-87fa-0daabf5fb4f4 service nova] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:53.850812 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:53.857585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe59b7-14a7-42f0-9132-d209b95facc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:53.858199 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe59b7-14a7-42f0-9132-d209b95facc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.858481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe59b7-14a7-42f0-9132-d209b95facc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.858757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe59b7-14a7-42f0-9132-d209b95facc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.859406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe59b7-14a7-42f0-9132-d209b95facc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:53.861014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe59b7-14a7-42f0-9132-d209b95facc2 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:53.872808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1226/2432] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:23:53.877237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322d48e-8dab-417e-b0ad-b583abdd5803 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:53.888413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322d48e-8dab-417e-b0ad-b583abdd5803 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:53.893224 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5781e5-9f36-4c16-9358-9fa463cb5216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:53.894492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5781e5-9f36-4c16-9358-9fa463cb5216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.894739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5781e5-9f36-4c16-9358-9fa463cb5216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.895052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5781e5-9f36-4c16-9358-9fa463cb5216 admin admin] PATH_INFO: `/v3/projects/3dc50a4181c14e0689ca8d9f1da9f67f/users/f899f837d91241f3bf819460208cff20/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.896975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5781e5-9f36-4c16-9358-9fa463cb5216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc50a4181c14e0689ca8d9f1da9f67f, user_id=f899f837d91241f3bf819460208cff20, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:53.899635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5781e5-9f36-4c16-9358-9fa463cb5216 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:53.910889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1207/2433] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:23:53 2022] PUT /identity/v3/projects/3dc50a4181c14e0689ca8d9f1da9f67f/users/f899f837d91241f3bf819460208cff20/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:23:53.921557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4fc7-1269-4a69-a31c-bf591b13c131 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:53.921923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4fc7-1269-4a69-a31c-bf591b13c131 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:53.922270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4fc7-1269-4a69-a31c-bf591b13c131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:53.951125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-256e4fc7-1269-4a69-a31c-bf591b13c131 None None] MFA Rules not processed for user `f899f837d91241f3bf819460208cff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:23:53.952487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-256e4fc7-1269-4a69-a31c-bf591b13c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:54.022252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1227/2434] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:23:54.033766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5781e5-9f36-4c16-9358-9fa463cb5216 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:54.035445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bf5781e5-9f36-4c16-9358-9fa463cb5216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:23:54.097576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5781e5-9f36-4c16-9358-9fa463cb5216 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:54.101419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a7b4-372d-42c0-aa41-0c55bf9b59be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:54.102030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a7b4-372d-42c0-aa41-0c55bf9b59be service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:54.102311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a7b4-372d-42c0-aa41-0c55bf9b59be service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:54.102591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a7b4-372d-42c0-aa41-0c55bf9b59be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:54.118364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a7b4-372d-42c0-aa41-0c55bf9b59be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:54.118364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a7b4-372d-42c0-aa41-0c55bf9b59be service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:54.126998 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1208/2435] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:54.338073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4fc7-1269-4a69-a31c-bf591b13c131 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:54.348550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4fc7-1269-4a69-a31c-bf591b13c131 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:54.352337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47452f96-7c50-415f-adcc-14cd33e20faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:54.352826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452f96-7c50-415f-adcc-14cd33e20faa service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:54.353107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452f96-7c50-415f-adcc-14cd33e20faa service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:54.353380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452f96-7c50-415f-adcc-14cd33e20faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:54.423123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47452f96-7c50-415f-adcc-14cd33e20faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:54.424601 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47452f96-7c50-415f-adcc-14cd33e20faa service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:54.434276 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1228/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:23:59.659049 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a7b4-372d-42c0-aa41-0c55bf9b59be service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:23:59.678019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:59.729582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a7b4-372d-42c0-aa41-0c55bf9b59be service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:23:59.734210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:23:59.734878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:23:59.735157 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:23:59.735430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] PATH_INFO: `/v3/users/3196f8bf7a854946acff9b17d5ab6ad4` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:23:59.736695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3196f8bf7a854946acff9b17d5ab6ad4)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:23:59.738642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:23:59.903860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3196f8bf7a854946acff9b17d5ab6ad4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:59.963071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3196f8bf7a854946acff9b17d5ab6ad4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:59.978418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3196f8bf7a854946acff9b17d5ab6ad4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:59.979281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3196f8bf7a854946acff9b17d5ab6ad4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:59.989343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3196f8bf7a854946acff9b17d5ab6ad4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:23:59.995605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1209/2437] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:23:59 2022] DELETE /identity/v3/users/3196f8bf7a854946acff9b17d5ab6ad4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:00.000040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93a2e-3f06-42ff-8ecd-306ff6ef6dac None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:00.000510 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93a2e-3f06-42ff-8ecd-306ff6ef6dac None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:00.000606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93a2e-3f06-42ff-8ecd-306ff6ef6dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:00.019843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-49c93a2e-3f06-42ff-8ecd-306ff6ef6dac None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:00.021036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-49c93a2e-3f06-42ff-8ecd-306ff6ef6dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:00.081075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1229/2438] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:00.092420 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:00.093818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:00.156922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8ef27-0ad5-40fc-8548-5a24762bae26 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:00.159492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b53815-05d2-41b0-8ad9-5a4d50881d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:00.160304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b53815-05d2-41b0-8ad9-5a4d50881d60 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:00.160593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b53815-05d2-41b0-8ad9-5a4d50881d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:00.160870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b53815-05d2-41b0-8ad9-5a4d50881d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:00.170570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b53815-05d2-41b0-8ad9-5a4d50881d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:00.172040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b53815-05d2-41b0-8ad9-5a4d50881d60 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:00.181830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1210/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:00.554434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93a2e-3f06-42ff-8ecd-306ff6ef6dac None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:00.556095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-49c93a2e-3f06-42ff-8ecd-306ff6ef6dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:00.568424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93a2e-3f06-42ff-8ecd-306ff6ef6dac None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:00.573592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:00.574250 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:00.574514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:00.574790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] PATH_INFO: `/v3/projects/c9ea2bbcf5584c2595651e214321e367` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:00.576006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ea2bbcf5584c2595651e214321e367)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:00.577910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:00.589252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:00.688926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ea2bbcf5584c2595651e214321e367', 'request_id': 'req-427196fd-9333-4029-8225-1b28902d4c8b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:00.791211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ea2bbcf5584c2595651e214321e367', 'request_id': 'req-427196fd-9333-4029-8225-1b28902d4c8b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:00.798155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ea2bbcf5584c2595651e214321e367', 'request_id': 'req-427196fd-9333-4029-8225-1b28902d4c8b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:00.809151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] The token cache is being invalidate because project c9ea2bbcf5584c2595651e214321e367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:00.809434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:00.810069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:00.811533 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1230/2440] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:00 2022] DELETE /identity/v3/projects/c9ea2bbcf5584c2595651e214321e367 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:00.815858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b53815-05d2-41b0-8ad9-5a4d50881d60 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:00.825714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b53815-05d2-41b0-8ad9-5a4d50881d60 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:00.859197 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:00.883642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:00.884296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:00.884583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:00.884857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] PATH_INFO: `/v3/users/f899f837d91241f3bf819460208cff20` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:00.885974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f899f837d91241f3bf819460208cff20)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:00.887930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:01.040214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f899f837d91241f3bf819460208cff20'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.094232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f899f837d91241f3bf819460208cff20'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.107545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f899f837d91241f3bf819460208cff20'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.108291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f899f837d91241f3bf819460208cff20'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.124171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-71d55edb-ab01-4f21-9d15-0e10f6777df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f899f837d91241f3bf819460208cff20'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.130517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1211/2441] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:00 2022] DELETE /identity/v3/users/f899f837d91241f3bf819460208cff20 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:01.507647 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:01.509100 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:01.525237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427196fd-9333-4029-8225-1b28902d4c8b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:01.589114 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:01.589767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:01.590044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:01.590313 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] PATH_INFO: `/v3/projects/3dc50a4181c14e0689ca8d9f1da9f67f` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:01.591420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc50a4181c14e0689ca8d9f1da9f67f)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:01.593331 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:01.682719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc50a4181c14e0689ca8d9f1da9f67f', 'request_id': 'req-89da0b5e-b849-4a7b-b96d-139d64591bf2'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.733809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc50a4181c14e0689ca8d9f1da9f67f', 'request_id': 'req-89da0b5e-b849-4a7b-b96d-139d64591bf2'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.741166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc50a4181c14e0689ca8d9f1da9f67f', 'request_id': 'req-89da0b5e-b849-4a7b-b96d-139d64591bf2'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.752035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] The token cache is being invalidate because project 3dc50a4181c14e0689ca8d9f1da9f67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:01.752323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.752949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89da0b5e-b849-4a7b-b96d-139d64591bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:01.754404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1231/2442] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:01 2022] DELETE /identity/v3/projects/3dc50a4181c14e0689ca8d9f1da9f67f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:01.760124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4225d-304e-49ed-b805-c3ae68cc7c00 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:01.760414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4225d-304e-49ed-b805-c3ae68cc7c00 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:01.760691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4225d-304e-49ed-b805-c3ae68cc7c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:01.780641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a1b4225d-304e-49ed-b805-c3ae68cc7c00 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:01.781851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a1b4225d-304e-49ed-b805-c3ae68cc7c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:01.840503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1212/2443] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:01.848425 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f660d-45aa-4ba7-a854-b6b7e75c7095 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:01.848808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f660d-45aa-4ba7-a854-b6b7e75c7095 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:01.848991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f660d-45aa-4ba7-a854-b6b7e75c7095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:01.868883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3e2f660d-45aa-4ba7-a854-b6b7e75c7095 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:01.870069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3e2f660d-45aa-4ba7-a854-b6b7e75c7095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:01.877708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1232/2444] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:01.882602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4225d-304e-49ed-b805-c3ae68cc7c00 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:01.892372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4225d-304e-49ed-b805-c3ae68cc7c00 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:01.897030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05058f-8f67-480a-8993-6e254141b952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:01.897634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05058f-8f67-480a-8993-6e254141b952 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:01.897923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05058f-8f67-480a-8993-6e254141b952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:01.898196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05058f-8f67-480a-8993-6e254141b952 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:01.898933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05058f-8f67-480a-8993-6e254141b952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:01.899239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05058f-8f67-480a-8993-6e254141b952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:01.900901 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05058f-8f67-480a-8993-6e254141b952 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:01.912549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1213/2445] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:24:01.916994 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f660d-45aa-4ba7-a854-b6b7e75c7095 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:01.926109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f660d-45aa-4ba7-a854-b6b7e75c7095 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:01.931347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64d8b-5856-407e-900a-5e80d7039b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:01.931996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64d8b-5856-407e-900a-5e80d7039b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:01.932283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64d8b-5856-407e-900a-5e80d7039b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:01.932560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64d8b-5856-407e-900a-5e80d7039b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:01.933191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e64d8b-5856-407e-900a-5e80d7039b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:01.935071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e64d8b-5856-407e-900a-5e80d7039b2f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:02.020858 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:02.027099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1233/2446] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:01 2022] POST /identity/v3/projects => generated 407 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:02.031419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05058f-8f67-480a-8993-6e254141b952 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:02.041432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05058f-8f67-480a-8993-6e254141b952 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:02.082743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:02.097795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1943c5-934b-4283-9c84-7634aea1a78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:02.098336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1943c5-934b-4283-9c84-7634aea1a78c admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:02.098618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1943c5-934b-4283-9c84-7634aea1a78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:02.098895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1943c5-934b-4283-9c84-7634aea1a78c admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:02.099552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1943c5-934b-4283-9c84-7634aea1a78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:02.102262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1943c5-934b-4283-9c84-7634aea1a78c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:02.180947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1214/2447] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:02 2022] POST /identity/v3/users => generated 304 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:02.185798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64d8b-5856-407e-900a-5e80d7039b2f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:02.196542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64d8b-5856-407e-900a-5e80d7039b2f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:02.202067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f38e-6067-4611-b490-1f8b2eb2adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:02.202751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f38e-6067-4611-b490-1f8b2eb2adee admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:02.202978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f38e-6067-4611-b490-1f8b2eb2adee admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:02.204910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f38e-6067-4611-b490-1f8b2eb2adee admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:02.204910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2f38e-6067-4611-b490-1f8b2eb2adee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:02.205800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2f38e-6067-4611-b490-1f8b2eb2adee admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:02.217354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1234/2448] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:02.225772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1943c5-934b-4283-9c84-7634aea1a78c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:02.236486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1943c5-934b-4283-9c84-7634aea1a78c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:02.241908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117f0d-b313-4773-87ca-bccd7538c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:02.243823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117f0d-b313-4773-87ca-bccd7538c7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:02.243823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117f0d-b313-4773-87ca-bccd7538c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:02.243823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117f0d-b313-4773-87ca-bccd7538c7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:02.243823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56117f0d-b313-4773-87ca-bccd7538c7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:02.245366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56117f0d-b313-4773-87ca-bccd7538c7b7 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:02.256364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1215/2449] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:02.260582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f38e-6067-4611-b490-1f8b2eb2adee admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:02.270999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f38e-6067-4611-b490-1f8b2eb2adee admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:02.275732 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2aa24-a803-41d8-9145-24109d11439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:02.278330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2aa24-a803-41d8-9145-24109d11439a admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:02.278330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2aa24-a803-41d8-9145-24109d11439a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:02.278330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2aa24-a803-41d8-9145-24109d11439a admin admin] PATH_INFO: `/v3/projects/13950e010be1410eb84abbe18091d137/users/24ffcf5773ef4c6f9fecc0636bf74ab6/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:02.292480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2aa24-a803-41d8-9145-24109d11439a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13950e010be1410eb84abbe18091d137, user_id=24ffcf5773ef4c6f9fecc0636bf74ab6, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:02.295220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2aa24-a803-41d8-9145-24109d11439a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:02.380294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1235/2450] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:02 2022] PUT /identity/v3/projects/13950e010be1410eb84abbe18091d137/users/24ffcf5773ef4c6f9fecc0636bf74ab6/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:02.395173 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72acb3e-1229-472e-945e-020c41a29c41 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:02.395460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72acb3e-1229-472e-945e-020c41a29c41 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:02.395770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72acb3e-1229-472e-945e-020c41a29c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:02.424274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-c72acb3e-1229-472e-945e-020c41a29c41 None None] MFA Rules not processed for user `24ffcf5773ef4c6f9fecc0636bf74ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:02.425531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c72acb3e-1229-472e-945e-020c41a29c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:02.492485 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1216/2451] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:02.497132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2aa24-a803-41d8-9145-24109d11439a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:02.564547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2aa24-a803-41d8-9145-24109d11439a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:02.569706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4e89a-f090-470b-8210-ac5d25460340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:02.570324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e89a-f090-470b-8210-ac5d25460340 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:02.570610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e89a-f090-470b-8210-ac5d25460340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:02.570886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e89a-f090-470b-8210-ac5d25460340 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:02.571526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4e89a-f090-470b-8210-ac5d25460340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:02.573462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4e89a-f090-470b-8210-ac5d25460340 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:02.672607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1236/2452] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:02 2022] POST /identity/v3/projects => generated 407 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:02.676849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72acb3e-1229-472e-945e-020c41a29c41 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:02.688530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72acb3e-1229-472e-945e-020c41a29c41 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:02.753579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827d8f2-0631-4493-bea8-e45ed9066109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:02.754178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827d8f2-0631-4493-bea8-e45ed9066109 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:02.754456 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827d8f2-0631-4493-bea8-e45ed9066109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:02.754728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827d8f2-0631-4493-bea8-e45ed9066109 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:02.755392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827d8f2-0631-4493-bea8-e45ed9066109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:02.757981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827d8f2-0631-4493-bea8-e45ed9066109 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:02.837225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1217/2453] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:02 2022] POST /identity/v3/users => generated 310 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:02.841238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4e89a-f090-470b-8210-ac5d25460340 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:02.853043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4e89a-f090-470b-8210-ac5d25460340 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:02.857772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89accca3-ab66-4781-9972-b992cb4f1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:02.859751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89accca3-ab66-4781-9972-b992cb4f1ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:02.859751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89accca3-ab66-4781-9972-b992cb4f1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:02.859751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89accca3-ab66-4781-9972-b992cb4f1ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:02.859751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89accca3-ab66-4781-9972-b992cb4f1ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:02.861132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89accca3-ab66-4781-9972-b992cb4f1ee5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:02.872573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1237/2454] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:02.876752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827d8f2-0631-4493-bea8-e45ed9066109 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:02.886879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827d8f2-0631-4493-bea8-e45ed9066109 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:02.891559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ddbb-e0d9-405c-ac6e-7eddcbe69d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:02.892241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ddbb-e0d9-405c-ac6e-7eddcbe69d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:02.892523 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ddbb-e0d9-405c-ac6e-7eddcbe69d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:02.892804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ddbb-e0d9-405c-ac6e-7eddcbe69d70 admin admin] PATH_INFO: `/v3/projects/44e418cc531a46d390b785a659231c10/users/928e9d6ff0dc4fc6b9085397dd6af5be/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:02.907934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0ddbb-e0d9-405c-ac6e-7eddcbe69d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e418cc531a46d390b785a659231c10, user_id=928e9d6ff0dc4fc6b9085397dd6af5be, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:02.910503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0ddbb-e0d9-405c-ac6e-7eddcbe69d70 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:02.956627 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1218/2455] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:02 2022] PUT /identity/v3/projects/44e418cc531a46d390b785a659231c10/users/928e9d6ff0dc4fc6b9085397dd6af5be/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:02.960628 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89accca3-ab66-4781-9972-b992cb4f1ee5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:02.970409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89accca3-ab66-4781-9972-b992cb4f1ee5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:03.025455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587c72-cb28-400e-9f6e-119cde49495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:03.026060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587c72-cb28-400e-9f6e-119cde49495e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:03.026340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587c72-cb28-400e-9f6e-119cde49495e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:03.026633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587c72-cb28-400e-9f6e-119cde49495e admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:03.027259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4587c72-cb28-400e-9f6e-119cde49495e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:03.028854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4587c72-cb28-400e-9f6e-119cde49495e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:03.038897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1238/2456] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:03.043063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ddbb-e0d9-405c-ac6e-7eddcbe69d70 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:03.053861 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ddbb-e0d9-405c-ac6e-7eddcbe69d70 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:03.058588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aaff69-5b1e-4fc4-a250-e2a71b05bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:03.059285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaff69-5b1e-4fc4-a250-e2a71b05bc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:03.059945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaff69-5b1e-4fc4-a250-e2a71b05bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:03.060227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaff69-5b1e-4fc4-a250-e2a71b05bc84 admin admin] PATH_INFO: `/v3/projects/44e418cc531a46d390b785a659231c10/users/928e9d6ff0dc4fc6b9085397dd6af5be/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:03.062112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aaff69-5b1e-4fc4-a250-e2a71b05bc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e418cc531a46d390b785a659231c10, user_id=928e9d6ff0dc4fc6b9085397dd6af5be, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:03.064805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aaff69-5b1e-4fc4-a250-e2a71b05bc84 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:03.075169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1219/2457] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:03 2022] PUT /identity/v3/projects/44e418cc531a46d390b785a659231c10/users/928e9d6ff0dc4fc6b9085397dd6af5be/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:03.085519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90ccb9-2707-4440-8f43-956480d0b111 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:03.085830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90ccb9-2707-4440-8f43-956480d0b111 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:03.086104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90ccb9-2707-4440-8f43-956480d0b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:03.114285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-cb90ccb9-2707-4440-8f43-956480d0b111 None None] MFA Rules not processed for user `928e9d6ff0dc4fc6b9085397dd6af5be`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:03.116186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cb90ccb9-2707-4440-8f43-956480d0b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:03.148206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:03.195119 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1239/2458] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:03.204663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aaff69-5b1e-4fc4-a250-e2a71b05bc84 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:03.206754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e5aaff69-5b1e-4fc4-a250-e2a71b05bc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:03.213370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:03.273692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aaff69-5b1e-4fc4-a250-e2a71b05bc84 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:03.277922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea7fb6-cd54-437a-b495-3aaec41c40ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:03.278614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea7fb6-cd54-437a-b495-3aaec41c40ad service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:03.279262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea7fb6-cd54-437a-b495-3aaec41c40ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:03.279262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea7fb6-cd54-437a-b495-3aaec41c40ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:03.290157 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea7fb6-cd54-437a-b495-3aaec41c40ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:03.291775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea7fb6-cd54-437a-b495-3aaec41c40ad service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:03.302534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1220/2459] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:03 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:03.625106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90ccb9-2707-4440-8f43-956480d0b111 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:03.635761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90ccb9-2707-4440-8f43-956480d0b111 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:03.639243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06611ff-99fd-4232-a288-93b4f0fb2eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:03.639879 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06611ff-99fd-4232-a288-93b4f0fb2eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:03.640145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06611ff-99fd-4232-a288-93b4f0fb2eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:03.640415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06611ff-99fd-4232-a288-93b4f0fb2eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:03.710223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06611ff-99fd-4232-a288-93b4f0fb2eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:03.711667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06611ff-99fd-4232-a288-93b4f0fb2eb1 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:03.721743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1240/2460] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:03 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:10.920621 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea7fb6-cd54-437a-b495-3aaec41c40ad service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:10.983897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea7fb6-cd54-437a-b495-3aaec41c40ad service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:10.988416 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:10.989021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:10.989304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:10.989580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] PATH_INFO: `/v3/users/24ffcf5773ef4c6f9fecc0636bf74ab6` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:10.990697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ffcf5773ef4c6f9fecc0636bf74ab6)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:10.992662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:11.148704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ffcf5773ef4c6f9fecc0636bf74ab6'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:11.214407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ffcf5773ef4c6f9fecc0636bf74ab6'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:11.227981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ffcf5773ef4c6f9fecc0636bf74ab6'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:11.228694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ffcf5773ef4c6f9fecc0636bf74ab6'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:11.236454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ffcf5773ef4c6f9fecc0636bf74ab6'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:11.242506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1221/2461] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:10 2022] DELETE /identity/v3/users/24ffcf5773ef4c6f9fecc0636bf74ab6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:11.247821 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dfe3b-1b9f-413d-af06-634f188a5321 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:11.248352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dfe3b-1b9f-413d-af06-634f188a5321 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:11.248352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dfe3b-1b9f-413d-af06-634f188a5321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:11.266847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d37dfe3b-1b9f-413d-af06-634f188a5321 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:11.268085 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d37dfe3b-1b9f-413d-af06-634f188a5321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:11.329953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1241/2462] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:11.343302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:11.345005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:11.378474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:11.406713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d767-1e5b-4c77-8111-4ea5166f6896 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:11.411140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5afb5-d41f-4bd1-81fa-9dc78bbba1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:11.411797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5afb5-d41f-4bd1-81fa-9dc78bbba1ff service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:11.412097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5afb5-d41f-4bd1-81fa-9dc78bbba1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:11.412428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5afb5-d41f-4bd1-81fa-9dc78bbba1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:11.423343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5afb5-d41f-4bd1-81fa-9dc78bbba1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:11.424831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5afb5-d41f-4bd1-81fa-9dc78bbba1ff service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:11.435165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1222/2463] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:11.465346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dfe3b-1b9f-413d-af06-634f188a5321 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:11.467119 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d37dfe3b-1b9f-413d-af06-634f188a5321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:11.528769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dfe3b-1b9f-413d-af06-634f188a5321 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:11.532563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267891c-d51d-4358-9305-2c845aa34ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:11.542399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267891c-d51d-4358-9305-2c845aa34ecc service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:11.542399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267891c-d51d-4358-9305-2c845aa34ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:11.542399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267891c-d51d-4358-9305-2c845aa34ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:11.542399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9267891c-d51d-4358-9305-2c845aa34ecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:11.549689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:11.600933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267891c-d51d-4358-9305-2c845aa34ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:11.602394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267891c-d51d-4358-9305-2c845aa34ecc service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:11.612656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1242/2464] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:11.897571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5afb5-d41f-4bd1-81fa-9dc78bbba1ff service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:11.900086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2ea5afb5-d41f-4bd1-81fa-9dc78bbba1ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:11.921347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5afb5-d41f-4bd1-81fa-9dc78bbba1ff service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:11.926989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:11.927639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:11.927950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:11.928221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] PATH_INFO: `/v3/projects/13950e010be1410eb84abbe18091d137` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:11.929744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13950e010be1410eb84abbe18091d137)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:11.931853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:12.039415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13950e010be1410eb84abbe18091d137', 'request_id': 'req-c4596167-8965-4e99-89ac-d188dff1f15a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.045681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13950e010be1410eb84abbe18091d137', 'request_id': 'req-c4596167-8965-4e99-89ac-d188dff1f15a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.123638 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13950e010be1410eb84abbe18091d137', 'request_id': 'req-c4596167-8965-4e99-89ac-d188dff1f15a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.139161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] The token cache is being invalidate because project 13950e010be1410eb84abbe18091d137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:12.139518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.140395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.141958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1223/2465] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:11 2022] DELETE /identity/v3/projects/13950e010be1410eb84abbe18091d137 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:12.152257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267891c-d51d-4358-9305-2c845aa34ecc service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:12.156664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267891c-d51d-4358-9305-2c845aa34ecc service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:12.221356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:12.222016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:12.222297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:12.222574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] PATH_INFO: `/v3/users/928e9d6ff0dc4fc6b9085397dd6af5be` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:12.223960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=928e9d6ff0dc4fc6b9085397dd6af5be)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:12.226189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:12.470226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928e9d6ff0dc4fc6b9085397dd6af5be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.471045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928e9d6ff0dc4fc6b9085397dd6af5be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.574384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928e9d6ff0dc4fc6b9085397dd6af5be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.575015 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928e9d6ff0dc4fc6b9085397dd6af5be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.583016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5a41730c-8113-45aa-9ba5-eedeb01be2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928e9d6ff0dc4fc6b9085397dd6af5be'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:12.603132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1243/2466] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:12 2022] DELETE /identity/v3/users/928e9d6ff0dc4fc6b9085397dd6af5be => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:13.106878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:13.108970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:13.123899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4596167-8965-4e99-89ac-d188dff1f15a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:13.195091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:13.195673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.195966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.196242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] PATH_INFO: `/v3/projects/44e418cc531a46d390b785a659231c10` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:13.197365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e418cc531a46d390b785a659231c10)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:13.199949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:13.283153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e418cc531a46d390b785a659231c10', 'request_id': 'req-cfc420ea-f443-43a2-8042-ad2ba5b42eea'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:13.289499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e418cc531a46d390b785a659231c10', 'request_id': 'req-cfc420ea-f443-43a2-8042-ad2ba5b42eea'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:13.291165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:13.339677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e418cc531a46d390b785a659231c10', 'request_id': 'req-cfc420ea-f443-43a2-8042-ad2ba5b42eea'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:13.350658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] The token cache is being invalidate because project 44e418cc531a46d390b785a659231c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:13.350951 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:13.351585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cfc420ea-f443-43a2-8042-ad2ba5b42eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:13.353126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1224/2467] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:13 2022] DELETE /identity/v3/projects/44e418cc531a46d390b785a659231c10 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:13.358620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0bb1b-825f-46fc-8087-a3c56d92ef5a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.358906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0bb1b-825f-46fc-8087-a3c56d92ef5a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.359181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0bb1b-825f-46fc-8087-a3c56d92ef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:13.380249 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-53d0bb1b-825f-46fc-8087-a3c56d92ef5a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:13.381572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-53d0bb1b-825f-46fc-8087-a3c56d92ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:13.405447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:13.441497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1244/2468] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:13.449464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b16469-518c-49e0-8ee2-877adf89e301 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.449688 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b16469-518c-49e0-8ee2-877adf89e301 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.449971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b16469-518c-49e0-8ee2-877adf89e301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:13.470307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e4b16469-518c-49e0-8ee2-877adf89e301 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:13.471507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e4b16469-518c-49e0-8ee2-877adf89e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:13.479972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1225/2469] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:13.484212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0bb1b-825f-46fc-8087-a3c56d92ef5a None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:13.493853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0bb1b-825f-46fc-8087-a3c56d92ef5a None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:13.499386 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a191c0-3ec4-4f44-bdb2-5ddeb489f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:13.500059 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a191c0-3ec4-4f44-bdb2-5ddeb489f244 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.500337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a191c0-3ec4-4f44-bdb2-5ddeb489f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.500607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a191c0-3ec4-4f44-bdb2-5ddeb489f244 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:13.501246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a191c0-3ec4-4f44-bdb2-5ddeb489f244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:13.501543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a191c0-3ec4-4f44-bdb2-5ddeb489f244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:13.503134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a191c0-3ec4-4f44-bdb2-5ddeb489f244 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:13.514854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1245/2470] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:24:13.519511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b16469-518c-49e0-8ee2-877adf89e301 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:13.529442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b16469-518c-49e0-8ee2-877adf89e301 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:13.534168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c0028-55a9-40d6-8a49-794984d71079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:13.534799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0028-55a9-40d6-8a49-794984d71079 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.535079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0028-55a9-40d6-8a49-794984d71079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.535349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0028-55a9-40d6-8a49-794984d71079 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:13.536030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c0028-55a9-40d6-8a49-794984d71079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:13.537907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c0028-55a9-40d6-8a49-794984d71079 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:13.615927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1226/2471] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:13 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:13.620713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a191c0-3ec4-4f44-bdb2-5ddeb489f244 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:13.631039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a191c0-3ec4-4f44-bdb2-5ddeb489f244 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:13.687544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cb9ff-28fe-4ed3-a91d-1803efc6379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:13.688173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb9ff-28fe-4ed3-a91d-1803efc6379a admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.688453 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb9ff-28fe-4ed3-a91d-1803efc6379a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.688726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb9ff-28fe-4ed3-a91d-1803efc6379a admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:13.689356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cb9ff-28fe-4ed3-a91d-1803efc6379a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:13.691255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cb9ff-28fe-4ed3-a91d-1803efc6379a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:13.780681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1246/2472] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:13 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:13.784882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c0028-55a9-40d6-8a49-794984d71079 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:13.795837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c0028-55a9-40d6-8a49-794984d71079 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:13.800499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98b7cd-fe33-4cd4-84f3-4c22df884c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:13.801103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98b7cd-fe33-4cd4-84f3-4c22df884c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.801388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98b7cd-fe33-4cd4-84f3-4c22df884c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.801666 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98b7cd-fe33-4cd4-84f3-4c22df884c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:13.802329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98b7cd-fe33-4cd4-84f3-4c22df884c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:13.803980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98b7cd-fe33-4cd4-84f3-4c22df884c39 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:13.813808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1227/2473] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:13.822062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cb9ff-28fe-4ed3-a91d-1803efc6379a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:13.832905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cb9ff-28fe-4ed3-a91d-1803efc6379a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:13.837569 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0b3fe-2e28-4c09-bd44-c99e3663a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:13.838186 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0b3fe-2e28-4c09-bd44-c99e3663a3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.839018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0b3fe-2e28-4c09-bd44-c99e3663a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.839298 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0b3fe-2e28-4c09-bd44-c99e3663a3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:13.840021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0b3fe-2e28-4c09-bd44-c99e3663a3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:13.841616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0b3fe-2e28-4c09-bd44-c99e3663a3e1 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:13.852539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1247/2474] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:13.857403 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98b7cd-fe33-4cd4-84f3-4c22df884c39 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:13.867350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98b7cd-fe33-4cd4-84f3-4c22df884c39 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:13.872164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac827d8b-8578-45eb-ab25-4fe2fd5dd0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:13.872813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac827d8b-8578-45eb-ab25-4fe2fd5dd0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.873091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac827d8b-8578-45eb-ab25-4fe2fd5dd0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.873370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac827d8b-8578-45eb-ab25-4fe2fd5dd0f9 admin admin] PATH_INFO: `/v3/projects/7906978cfdab4427986fa93940f29aa9/users/32de460a9bb0467eacf7e901cddca309/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:13.889154 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac827d8b-8578-45eb-ab25-4fe2fd5dd0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7906978cfdab4427986fa93940f29aa9, user_id=32de460a9bb0467eacf7e901cddca309, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:13.891873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac827d8b-8578-45eb-ab25-4fe2fd5dd0f9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:13.963881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1228/2475] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:13 2022] PUT /identity/v3/projects/7906978cfdab4427986fa93940f29aa9/users/32de460a9bb0467eacf7e901cddca309/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:13.977463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5175-7a74-47ea-a61f-58cc989dba7b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:13.977750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5175-7a74-47ea-a61f-58cc989dba7b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:13.978026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5175-7a74-47ea-a61f-58cc989dba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:14.007464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-eb8f5175-7a74-47ea-a61f-58cc989dba7b None None] MFA Rules not processed for user `32de460a9bb0467eacf7e901cddca309`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:14.009297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-eb8f5175-7a74-47ea-a61f-58cc989dba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:14.078003 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1248/2476] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:14.082866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac827d8b-8578-45eb-ab25-4fe2fd5dd0f9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:14.118024 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f5175-7a74-47ea-a61f-58cc989dba7b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:14.120592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-eb8f5175-7a74-47ea-a61f-58cc989dba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:14.156277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:14.159795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac827d8b-8578-45eb-ab25-4fe2fd5dd0f9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:14.180524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e577c-1768-4526-af5a-1068e465f8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:14.181263 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e577c-1768-4526-af5a-1068e465f8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:14.181615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e577c-1768-4526-af5a-1068e465f8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:14.181958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e577c-1768-4526-af5a-1068e465f8c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:14.183280 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e577c-1768-4526-af5a-1068e465f8c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:14.185388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e577c-1768-4526-af5a-1068e465f8c9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:14.208079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f5175-7a74-47ea-a61f-58cc989dba7b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:14.213657 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ea6cc-2af9-4ee0-b21d-41856f662be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:14.214263 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ea6cc-2af9-4ee0-b21d-41856f662be9 service nova] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:14.214548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ea6cc-2af9-4ee0-b21d-41856f662be9 service nova] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:14.214824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ea6cc-2af9-4ee0-b21d-41856f662be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:14.216567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bb3ea6cc-2af9-4ee0-b21d-41856f662be9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:14.278751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ea6cc-2af9-4ee0-b21d-41856f662be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:14.280415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ea6cc-2af9-4ee0-b21d-41856f662be9 service nova] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:14.289774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1249/2477] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:14.366231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1229/2478] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:14 2022] POST /identity/v3/projects => generated 363 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:14.370881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ea6cc-2af9-4ee0-b21d-41856f662be9 service nova] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:14.381492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ea6cc-2af9-4ee0-b21d-41856f662be9 service nova] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:14.445463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea75470-79f9-456e-9d27-9a7dc9a6ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:14.446080 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea75470-79f9-456e-9d27-9a7dc9a6ad5f admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:14.446362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea75470-79f9-456e-9d27-9a7dc9a6ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:14.446634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea75470-79f9-456e-9d27-9a7dc9a6ad5f admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:14.447378 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea75470-79f9-456e-9d27-9a7dc9a6ad5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:14.450151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea75470-79f9-456e-9d27-9a7dc9a6ad5f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:14.583195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1250/2479] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:14 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:14.587506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e577c-1768-4526-af5a-1068e465f8c9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:14.598261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e577c-1768-4526-af5a-1068e465f8c9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:14.602810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37b044-b5e5-45cf-a33c-4fe6dfdfaca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:14.603422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b044-b5e5-45cf-a33c-4fe6dfdfaca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:14.603740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b044-b5e5-45cf-a33c-4fe6dfdfaca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:14.604052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b044-b5e5-45cf-a33c-4fe6dfdfaca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:14.604671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37b044-b5e5-45cf-a33c-4fe6dfdfaca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:14.606260 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37b044-b5e5-45cf-a33c-4fe6dfdfaca9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:14.617191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1230/2480] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:14.627824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea75470-79f9-456e-9d27-9a7dc9a6ad5f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:14.638655 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea75470-79f9-456e-9d27-9a7dc9a6ad5f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:14.643459 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5d93c-95cc-4e11-83e5-90d6e0523c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:14.644206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5d93c-95cc-4e11-83e5-90d6e0523c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:14.644495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5d93c-95cc-4e11-83e5-90d6e0523c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:14.644793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5d93c-95cc-4e11-83e5-90d6e0523c3b admin admin] PATH_INFO: `/v3/projects/cba20793e2e34a118dd370fbb27d97f7/users/c19b1a7ecb4a472a92075b6304aa10ac/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:14.662699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5d93c-95cc-4e11-83e5-90d6e0523c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba20793e2e34a118dd370fbb27d97f7, user_id=c19b1a7ecb4a472a92075b6304aa10ac, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:14.665396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5d93c-95cc-4e11-83e5-90d6e0523c3b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:14.752793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1251/2481] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:14 2022] PUT /identity/v3/projects/cba20793e2e34a118dd370fbb27d97f7/users/c19b1a7ecb4a472a92075b6304aa10ac/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:14.756828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37b044-b5e5-45cf-a33c-4fe6dfdfaca9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:14.767491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37b044-b5e5-45cf-a33c-4fe6dfdfaca9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:14.816510 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:14.825498 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4706b-4b76-4bc7-8519-421564a9ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:14.826114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4706b-4b76-4bc7-8519-421564a9ce5c admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:14.826401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4706b-4b76-4bc7-8519-421564a9ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:14.826679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4706b-4b76-4bc7-8519-421564a9ce5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:14.827322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4706b-4b76-4bc7-8519-421564a9ce5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:14.828959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4706b-4b76-4bc7-8519-421564a9ce5c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:14.839259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1231/2482] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:14.845723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5d93c-95cc-4e11-83e5-90d6e0523c3b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:14.853705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5d93c-95cc-4e11-83e5-90d6e0523c3b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:14.858852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee62b8-7e7f-4fd1-b87d-1afd34393b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:14.859504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee62b8-7e7f-4fd1-b87d-1afd34393b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:14.859815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee62b8-7e7f-4fd1-b87d-1afd34393b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:14.860093 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee62b8-7e7f-4fd1-b87d-1afd34393b99 admin admin] PATH_INFO: `/v3/projects/cba20793e2e34a118dd370fbb27d97f7/users/c19b1a7ecb4a472a92075b6304aa10ac/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:14.861970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee62b8-7e7f-4fd1-b87d-1afd34393b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba20793e2e34a118dd370fbb27d97f7, user_id=c19b1a7ecb4a472a92075b6304aa10ac, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:14.864634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee62b8-7e7f-4fd1-b87d-1afd34393b99 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:14.885215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1252/2483] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:14 2022] PUT /identity/v3/projects/cba20793e2e34a118dd370fbb27d97f7/users/c19b1a7ecb4a472a92075b6304aa10ac/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:14.887387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29149dcd-dba4-4136-b175-63f84537f0c4 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:14.887816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29149dcd-dba4-4136-b175-63f84537f0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:14.888169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29149dcd-dba4-4136-b175-63f84537f0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:14.921728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-29149dcd-dba4-4136-b175-63f84537f0c4 None None] MFA Rules not processed for user `c19b1a7ecb4a472a92075b6304aa10ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:14.922937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-29149dcd-dba4-4136-b175-63f84537f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:14.997969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1232/2484] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:15.013222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee62b8-7e7f-4fd1-b87d-1afd34393b99 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:15.015056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-00ee62b8-7e7f-4fd1-b87d-1afd34393b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:15.035667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:15.076537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee62b8-7e7f-4fd1-b87d-1afd34393b99 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:15.080218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62049314-34b3-4cde-a299-8e5c1aa17450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:15.081099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62049314-34b3-4cde-a299-8e5c1aa17450 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:15.081377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62049314-34b3-4cde-a299-8e5c1aa17450 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:15.081646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62049314-34b3-4cde-a299-8e5c1aa17450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:15.090910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62049314-34b3-4cde-a299-8e5c1aa17450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:15.092359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62049314-34b3-4cde-a299-8e5c1aa17450 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:15.101761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1253/2485] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:15.338073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29149dcd-dba4-4136-b175-63f84537f0c4 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:15.348293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29149dcd-dba4-4136-b175-63f84537f0c4 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:15.351817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10e0ad-8bd0-4d59-848b-efb5352abcf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:15.352414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10e0ad-8bd0-4d59-848b-efb5352abcf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:15.354898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10e0ad-8bd0-4d59-848b-efb5352abcf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:15.354898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10e0ad-8bd0-4d59-848b-efb5352abcf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:15.409153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10e0ad-8bd0-4d59-848b-efb5352abcf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:15.410584 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10e0ad-8bd0-4d59-848b-efb5352abcf6 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:15.420191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1233/2486] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:20.426934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b716447-09b0-4aef-85dc-17a812bff3d6 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:20.427459 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b716447-09b0-4aef-85dc-17a812bff3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:20.427734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b716447-09b0-4aef-85dc-17a812bff3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:20.456969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-0b716447-09b0-4aef-85dc-17a812bff3d6 None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:20.458238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0b716447-09b0-4aef-85dc-17a812bff3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:20.522825 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1254/2487] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:20.756570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10e0ad-8bd0-4d59-848b-efb5352abcf6 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:20.758115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-1d10e0ad-8bd0-4d59-848b-efb5352abcf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:20.833226 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10e0ad-8bd0-4d59-848b-efb5352abcf6 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:20.838539 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55bf8-34c8-48e8-83a3-6f11481d5968 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:20.839155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55bf8-34c8-48e8-83a3-6f11481d5968 service swift] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:20.839441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55bf8-34c8-48e8-83a3-6f11481d5968 service swift] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:20.839752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55bf8-34c8-48e8-83a3-6f11481d5968 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:20.848598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c55bf8-34c8-48e8-83a3-6f11481d5968 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:20.850237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c55bf8-34c8-48e8-83a3-6f11481d5968 service swift] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:20.868427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1234/2488] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:24:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:24:22.236745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b716447-09b0-4aef-85dc-17a812bff3d6 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:22.327514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b716447-09b0-4aef-85dc-17a812bff3d6 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:22.333203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:22.333967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:22.334256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:22.336225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] PATH_INFO: `/v3/users/32de460a9bb0467eacf7e901cddca309` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:22.336225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=32de460a9bb0467eacf7e901cddca309)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:22.338421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:22.625783 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32de460a9bb0467eacf7e901cddca309'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:22.627576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32de460a9bb0467eacf7e901cddca309'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:22.708117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32de460a9bb0467eacf7e901cddca309'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:22.711705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32de460a9bb0467eacf7e901cddca309'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:22.742393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32de460a9bb0467eacf7e901cddca309'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:22.744565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:22.785504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1255/2489] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:22 2022] DELETE /identity/v3/users/32de460a9bb0467eacf7e901cddca309 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:22.792192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6b26a-fcb8-4807-84a2-9acc2f0ef09e None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:22.793136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6b26a-fcb8-4807-84a2-9acc2f0ef09e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:22.793755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6b26a-fcb8-4807-84a2-9acc2f0ef09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:22.801849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:22.817647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-fdf6b26a-fcb8-4807-84a2-9acc2f0ef09e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:22.819975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-fdf6b26a-fcb8-4807-84a2-9acc2f0ef09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:22.901986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1235/2490] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:22.912869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:22.914622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:22.986596 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37da03-9021-4ea1-b9be-706db4235cce admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:22.990462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f799-e568-4eb2-a083-f8906df77f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:22.991179 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f799-e568-4eb2-a083-f8906df77f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:22.991531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f799-e568-4eb2-a083-f8906df77f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:22.991903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f799-e568-4eb2-a083-f8906df77f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:23.004909 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4f799-e568-4eb2-a083-f8906df77f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:23.006027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4f799-e568-4eb2-a083-f8906df77f8f service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:23.022977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1256/2491] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:23.674696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6b26a-fcb8-4807-84a2-9acc2f0ef09e None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:23.677434 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-fdf6b26a-fcb8-4807-84a2-9acc2f0ef09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:23.721155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6b26a-fcb8-4807-84a2-9acc2f0ef09e None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:23.745110 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:23.746033 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:23.746475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:23.746899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] PATH_INFO: `/v3/projects/7906978cfdab4427986fa93940f29aa9` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:23.752305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7906978cfdab4427986fa93940f29aa9)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:23.756132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:23.901414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7906978cfdab4427986fa93940f29aa9', 'request_id': 'req-011f783e-2123-4e0c-8262-0aecd48f00e9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:23.921705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7906978cfdab4427986fa93940f29aa9', 'request_id': 'req-011f783e-2123-4e0c-8262-0aecd48f00e9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:24.032664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7906978cfdab4427986fa93940f29aa9', 'request_id': 'req-011f783e-2123-4e0c-8262-0aecd48f00e9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:24.052402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] The token cache is being invalidate because project 7906978cfdab4427986fa93940f29aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:24.053295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:24.054698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:24.059237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1236/2492] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:23 2022] DELETE /identity/v3/projects/7906978cfdab4427986fa93940f29aa9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:24.065946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f799-e568-4eb2-a083-f8906df77f8f service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:24.078788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f799-e568-4eb2-a083-f8906df77f8f service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:24.167105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:24.168092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:24.168375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:24.168774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] PATH_INFO: `/v3/users/c19b1a7ecb4a472a92075b6304aa10ac` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:24.170072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19b1a7ecb4a472a92075b6304aa10ac)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:24.172011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:24.457565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19b1a7ecb4a472a92075b6304aa10ac'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:24.458397 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19b1a7ecb4a472a92075b6304aa10ac'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:24.608922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19b1a7ecb4a472a92075b6304aa10ac'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:24.609737 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19b1a7ecb4a472a92075b6304aa10ac'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:24.618581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6a92d83a-fc27-4751-9b17-095042b5ab3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19b1a7ecb4a472a92075b6304aa10ac'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:24.646700 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1257/2493] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:24 2022] DELETE /identity/v3/users/c19b1a7ecb4a472a92075b6304aa10ac => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:25.196205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:25.198381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:25.245284 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f783e-2123-4e0c-8262-0aecd48f00e9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:25.338165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:25.339039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:25.339389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:25.339894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] PATH_INFO: `/v3/projects/cba20793e2e34a118dd370fbb27d97f7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:25.341332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba20793e2e34a118dd370fbb27d97f7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:25.343776 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:25.468714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:25.488168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba20793e2e34a118dd370fbb27d97f7', 'request_id': 'req-5bebabf7-06d6-4c4b-ba00-47959c178670'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:25.496593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba20793e2e34a118dd370fbb27d97f7', 'request_id': 'req-5bebabf7-06d6-4c4b-ba00-47959c178670'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:25.610382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba20793e2e34a118dd370fbb27d97f7', 'request_id': 'req-5bebabf7-06d6-4c4b-ba00-47959c178670'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:25.644385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] The token cache is being invalidate because project cba20793e2e34a118dd370fbb27d97f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:25.644786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:25.646882 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5bebabf7-06d6-4c4b-ba00-47959c178670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:25.651240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1237/2494] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:25 2022] DELETE /identity/v3/projects/cba20793e2e34a118dd370fbb27d97f7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:25.653785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da9b2-1938-4fc7-91b6-ad856f59b6bf None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:25.654258 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da9b2-1938-4fc7-91b6-ad856f59b6bf None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:25.654506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da9b2-1938-4fc7-91b6-ad856f59b6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:25.679131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:25.725685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d94da9b2-1938-4fc7-91b6-ad856f59b6bf None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:25.726935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d94da9b2-1938-4fc7-91b6-ad856f59b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:25.941402 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1258/2495] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:25.951391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a874d4-ca49-478f-80ca-80ce742b4cc0 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:25.951923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a874d4-ca49-478f-80ca-80ce742b4cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:25.952411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a874d4-ca49-478f-80ca-80ce742b4cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:25.986241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-45a874d4-ca49-478f-80ca-80ce742b4cc0 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:25.987550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-45a874d4-ca49-478f-80ca-80ce742b4cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:26.020745 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1238/2496] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:26.022540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94da9b2-1938-4fc7-91b6-ad856f59b6bf None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:26.040983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94da9b2-1938-4fc7-91b6-ad856f59b6bf None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:26.052883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced4d7-c198-498f-ab59-ae4d19e9ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:26.054003 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced4d7-c198-498f-ab59-ae4d19e9ec72 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:26.054205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced4d7-c198-498f-ab59-ae4d19e9ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:26.054502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced4d7-c198-498f-ab59-ae4d19e9ec72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:26.057234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aced4d7-c198-498f-ab59-ae4d19e9ec72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:26.057602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aced4d7-c198-498f-ab59-ae4d19e9ec72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:26.067886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aced4d7-c198-498f-ab59-ae4d19e9ec72 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:26.082924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1259/2497] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:24:26.084974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a874d4-ca49-478f-80ca-80ce742b4cc0 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:26.100304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a874d4-ca49-478f-80ca-80ce742b4cc0 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:26.123395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f602a-9db5-4bf3-b687-c102df2e8f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:26.123395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f602a-9db5-4bf3-b687-c102df2e8f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:26.123395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f602a-9db5-4bf3-b687-c102df2e8f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:26.123395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f602a-9db5-4bf3-b687-c102df2e8f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:26.123821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f602a-9db5-4bf3-b687-c102df2e8f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:26.123821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f602a-9db5-4bf3-b687-c102df2e8f63 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:26.240155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1239/2498] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:26 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:26.246009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced4d7-c198-498f-ab59-ae4d19e9ec72 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:26.257772 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced4d7-c198-498f-ab59-ae4d19e9ec72 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:26.339317 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366cf84-e346-4949-b362-9244eebbc20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:26.340013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366cf84-e346-4949-b362-9244eebbc20f admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:26.340471 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366cf84-e346-4949-b362-9244eebbc20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:26.341160 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366cf84-e346-4949-b362-9244eebbc20f admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:26.342935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366cf84-e346-4949-b362-9244eebbc20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:26.345251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366cf84-e346-4949-b362-9244eebbc20f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:26.462474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1260/2499] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:26 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:26.467076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f602a-9db5-4bf3-b687-c102df2e8f63 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:26.482021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f602a-9db5-4bf3-b687-c102df2e8f63 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:26.487603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac4a24-8f82-49b8-bc91-1963070ccfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:26.488474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac4a24-8f82-49b8-bc91-1963070ccfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:26.488945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac4a24-8f82-49b8-bc91-1963070ccfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:26.489446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac4a24-8f82-49b8-bc91-1963070ccfa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:26.490269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac4a24-8f82-49b8-bc91-1963070ccfa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:26.494234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac4a24-8f82-49b8-bc91-1963070ccfa0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:26.509211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1240/2500] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:26.514567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366cf84-e346-4949-b362-9244eebbc20f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:26.526144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366cf84-e346-4949-b362-9244eebbc20f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:26.531032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cd51d-1a3e-4914-86d3-5d439d0c2439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:26.531682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cd51d-1a3e-4914-86d3-5d439d0c2439 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:26.531947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cd51d-1a3e-4914-86d3-5d439d0c2439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:26.532226 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cd51d-1a3e-4914-86d3-5d439d0c2439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:26.532841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cd51d-1a3e-4914-86d3-5d439d0c2439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:26.534593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cd51d-1a3e-4914-86d3-5d439d0c2439 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:26.548071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1261/2501] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:26.552625 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac4a24-8f82-49b8-bc91-1963070ccfa0 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:26.564471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac4a24-8f82-49b8-bc91-1963070ccfa0 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:26.569397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23e1d7-391f-4eeb-ae00-ee26dea46547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:26.570097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23e1d7-391f-4eeb-ae00-ee26dea46547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:26.570377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23e1d7-391f-4eeb-ae00-ee26dea46547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:26.570654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23e1d7-391f-4eeb-ae00-ee26dea46547 admin admin] PATH_INFO: `/v3/projects/97eeb92015b745eb829a16bde1a2cffc/users/cc291512a1a943d6b9fcc4561cf54f3b/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:26.590709 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23e1d7-391f-4eeb-ae00-ee26dea46547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97eeb92015b745eb829a16bde1a2cffc, user_id=cc291512a1a943d6b9fcc4561cf54f3b, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:26.593392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23e1d7-391f-4eeb-ae00-ee26dea46547 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:26.688397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1241/2502] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:26 2022] PUT /identity/v3/projects/97eeb92015b745eb829a16bde1a2cffc/users/cc291512a1a943d6b9fcc4561cf54f3b/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:26.690296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd815c1-b1fa-46c5-9e34-113f418ed450 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:26.692702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd815c1-b1fa-46c5-9e34-113f418ed450 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:26.693192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd815c1-b1fa-46c5-9e34-113f418ed450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:26.731789 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4dd815c1-b1fa-46c5-9e34-113f418ed450 None None] MFA Rules not processed for user `cc291512a1a943d6b9fcc4561cf54f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:26.733033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4dd815c1-b1fa-46c5-9e34-113f418ed450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:26.818625 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:26.832153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1262/2503] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:26.838514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23e1d7-391f-4eeb-ae00-ee26dea46547 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:26.926466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23e1d7-391f-4eeb-ae00-ee26dea46547 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:26.939256 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df4f1b-9367-4ca1-b55f-8bae6ceb4482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:26.940011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df4f1b-9367-4ca1-b55f-8bae6ceb4482 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:26.940309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df4f1b-9367-4ca1-b55f-8bae6ceb4482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:26.940593 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df4f1b-9367-4ca1-b55f-8bae6ceb4482 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:26.941669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df4f1b-9367-4ca1-b55f-8bae6ceb4482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:26.943952 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df4f1b-9367-4ca1-b55f-8bae6ceb4482 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:27.018274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1242/2504] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:26 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:27.021972 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd815c1-b1fa-46c5-9e34-113f418ed450 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:27.034366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd815c1-b1fa-46c5-9e34-113f418ed450 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:27.120366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f162a-0cba-41d9-80e8-e3284741e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:27.125667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f162a-0cba-41d9-80e8-e3284741e987 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:27.126787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f162a-0cba-41d9-80e8-e3284741e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:27.128634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f162a-0cba-41d9-80e8-e3284741e987 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:27.129560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f162a-0cba-41d9-80e8-e3284741e987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:27.134325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f162a-0cba-41d9-80e8-e3284741e987 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:27.221927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1263/2505] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:27 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:27.227068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df4f1b-9367-4ca1-b55f-8bae6ceb4482 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:27.245290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df4f1b-9367-4ca1-b55f-8bae6ceb4482 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:27.251746 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655e418-0c00-4dd3-95f9-6f452999d576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:27.252674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655e418-0c00-4dd3-95f9-6f452999d576 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:27.253116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655e418-0c00-4dd3-95f9-6f452999d576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:27.253580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655e418-0c00-4dd3-95f9-6f452999d576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:27.254405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655e418-0c00-4dd3-95f9-6f452999d576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:27.256570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655e418-0c00-4dd3-95f9-6f452999d576 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:27.287314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1243/2506] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:27.293147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f162a-0cba-41d9-80e8-e3284741e987 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:27.320069 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f162a-0cba-41d9-80e8-e3284741e987 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:27.327855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe99993-df88-427e-8970-2b511eac2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:27.328697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe99993-df88-427e-8970-2b511eac2f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:27.329144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe99993-df88-427e-8970-2b511eac2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:27.329461 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe99993-df88-427e-8970-2b511eac2f0b admin admin] PATH_INFO: `/v3/projects/f0de772b05c14d05afe876314e5e06a6/users/133f980f2bc14230a340495b63c75ec1/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:27.351443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe99993-df88-427e-8970-2b511eac2f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0de772b05c14d05afe876314e5e06a6, user_id=133f980f2bc14230a340495b63c75ec1, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:27.355614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe99993-df88-427e-8970-2b511eac2f0b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:27.452345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1264/2507] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:27 2022] PUT /identity/v3/projects/f0de772b05c14d05afe876314e5e06a6/users/133f980f2bc14230a340495b63c75ec1/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:27.459298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655e418-0c00-4dd3-95f9-6f452999d576 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:27.474605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655e418-0c00-4dd3-95f9-6f452999d576 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:27.535774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:27.587020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729568f9-bb07-4f07-93db-e6f5e684ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:27.587561 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729568f9-bb07-4f07-93db-e6f5e684ec72 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:27.587868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729568f9-bb07-4f07-93db-e6f5e684ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:27.588164 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729568f9-bb07-4f07-93db-e6f5e684ec72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:27.589422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729568f9-bb07-4f07-93db-e6f5e684ec72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:27.591029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729568f9-bb07-4f07-93db-e6f5e684ec72 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:27.607717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1244/2508] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:27.609767 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe99993-df88-427e-8970-2b511eac2f0b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:27.626263 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe99993-df88-427e-8970-2b511eac2f0b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:27.631864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f54efe-8fc8-4ca4-b71d-cdebb909a53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:27.632634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f54efe-8fc8-4ca4-b71d-cdebb909a53f admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:27.632926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f54efe-8fc8-4ca4-b71d-cdebb909a53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:27.633207 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f54efe-8fc8-4ca4-b71d-cdebb909a53f admin admin] PATH_INFO: `/v3/projects/f0de772b05c14d05afe876314e5e06a6/users/133f980f2bc14230a340495b63c75ec1/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:27.635691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f54efe-8fc8-4ca4-b71d-cdebb909a53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0de772b05c14d05afe876314e5e06a6, user_id=133f980f2bc14230a340495b63c75ec1, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:27.638724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f54efe-8fc8-4ca4-b71d-cdebb909a53f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:27.659886 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1265/2509] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:27 2022] PUT /identity/v3/projects/f0de772b05c14d05afe876314e5e06a6/users/133f980f2bc14230a340495b63c75ec1/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:27.674682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649ff94-55f1-4f0e-aa39-5ce2a1e03981 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:27.677000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649ff94-55f1-4f0e-aa39-5ce2a1e03981 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:27.679261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649ff94-55f1-4f0e-aa39-5ce2a1e03981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:27.719518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e649ff94-55f1-4f0e-aa39-5ce2a1e03981 None None] MFA Rules not processed for user `133f980f2bc14230a340495b63c75ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:27.720910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e649ff94-55f1-4f0e-aa39-5ce2a1e03981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:27.838307 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1245/2510] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:27.850692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f54efe-8fc8-4ca4-b71d-cdebb909a53f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:27.853554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-72f54efe-8fc8-4ca4-b71d-cdebb909a53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:27.934873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f54efe-8fc8-4ca4-b71d-cdebb909a53f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:27.938698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc133d87-1c22-44bc-80e0-7cb62a4d7309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:27.939592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc133d87-1c22-44bc-80e0-7cb62a4d7309 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:27.939909 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc133d87-1c22-44bc-80e0-7cb62a4d7309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:27.940191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc133d87-1c22-44bc-80e0-7cb62a4d7309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:27.959419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc133d87-1c22-44bc-80e0-7cb62a4d7309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:27.961004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc133d87-1c22-44bc-80e0-7cb62a4d7309 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:27.976837 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1266/2511] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:28.753845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649ff94-55f1-4f0e-aa39-5ce2a1e03981 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:28.821921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc133d87-1c22-44bc-80e0-7cb62a4d7309 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:28.823902 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bc133d87-1c22-44bc-80e0-7cb62a4d7309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:28.830128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649ff94-55f1-4f0e-aa39-5ce2a1e03981 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:28.836562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:28.837212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:28.837497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:28.837834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] PATH_INFO: `/v3/users/cc291512a1a943d6b9fcc4561cf54f3b` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:28.839607 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc291512a1a943d6b9fcc4561cf54f3b)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:28.844327 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:28.894000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc133d87-1c22-44bc-80e0-7cb62a4d7309 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:28.901238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a7490-ee40-43fe-a28f-b564c1d74aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:28.901238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a7490-ee40-43fe-a28f-b564c1d74aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:28.901238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a7490-ee40-43fe-a28f-b564c1d74aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:28.901238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a7490-ee40-43fe-a28f-b564c1d74aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:28.902422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e33a7490-ee40-43fe-a28f-b564c1d74aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:28.924835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:28.927933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a7490-ee40-43fe-a28f-b564c1d74aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:28.932392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a7490-ee40-43fe-a28f-b564c1d74aa1 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:28.945169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1267/2512] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:24:29.126222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc291512a1a943d6b9fcc4561cf54f3b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:29.133227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:29.243773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc291512a1a943d6b9fcc4561cf54f3b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:29.267734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc291512a1a943d6b9fcc4561cf54f3b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:29.268490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc291512a1a943d6b9fcc4561cf54f3b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:29.278118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc291512a1a943d6b9fcc4561cf54f3b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:29.285269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1246/2513] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:28 2022] DELETE /identity/v3/users/cc291512a1a943d6b9fcc4561cf54f3b => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:29.292305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12c10-bc9b-4a9b-badf-4a132e1252f4 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:29.292977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12c10-bc9b-4a9b-badf-4a132e1252f4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:29.293468 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b12c10-bc9b-4a9b-badf-4a132e1252f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:29.334536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-67b12c10-bc9b-4a9b-badf-4a132e1252f4 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:29.336167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-67b12c10-bc9b-4a9b-badf-4a132e1252f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:29.471308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1268/2514] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:29.472042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:29.474136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:29.561903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852688d-1fd2-4299-be97-82fcbf046e2a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:29.565779 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f802e-d762-4ee0-ab9b-30c21170631d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:29.566411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f802e-d762-4ee0-ab9b-30c21170631d service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:29.566684 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f802e-d762-4ee0-ab9b-30c21170631d service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:29.567033 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f802e-d762-4ee0-ab9b-30c21170631d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:29.578687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f802e-d762-4ee0-ab9b-30c21170631d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:29.580121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f802e-d762-4ee0-ab9b-30c21170631d service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:29.591833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1247/2515] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:24:30.240433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12c10-bc9b-4a9b-badf-4a132e1252f4 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:30.242070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-67b12c10-bc9b-4a9b-badf-4a132e1252f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:30.296014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b12c10-bc9b-4a9b-badf-4a132e1252f4 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:30.304776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:30.305607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:30.305966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:30.306318 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] PATH_INFO: `/v3/projects/97eeb92015b745eb829a16bde1a2cffc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:30.307895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97eeb92015b745eb829a16bde1a2cffc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:30.312696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:30.534664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97eeb92015b745eb829a16bde1a2cffc', 'request_id': 'req-2dbc16d1-cb83-4c06-b305-33988d68d7a9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:30.655863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97eeb92015b745eb829a16bde1a2cffc', 'request_id': 'req-2dbc16d1-cb83-4c06-b305-33988d68d7a9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:30.666354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97eeb92015b745eb829a16bde1a2cffc', 'request_id': 'req-2dbc16d1-cb83-4c06-b305-33988d68d7a9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:30.696137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] The token cache is being invalidate because project 97eeb92015b745eb829a16bde1a2cffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:30.698332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:30.703724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:30.704025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1269/2516] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:30 2022] DELETE /identity/v3/projects/97eeb92015b745eb829a16bde1a2cffc => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:30.708245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f802e-d762-4ee0-ab9b-30c21170631d service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:30.722503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f802e-d762-4ee0-ab9b-30c21170631d service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:30.826503 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:30.827028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:30.827427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:30.827797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] PATH_INFO: `/v3/users/133f980f2bc14230a340495b63c75ec1` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:30.832462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133f980f2bc14230a340495b63c75ec1)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:30.834616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:31.115728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133f980f2bc14230a340495b63c75ec1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:31.215074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133f980f2bc14230a340495b63c75ec1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:31.237755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133f980f2bc14230a340495b63c75ec1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:31.238677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133f980f2bc14230a340495b63c75ec1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:31.240511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:31.248532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-627b9514-f11c-4d4f-8d3e-134134463369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133f980f2bc14230a340495b63c75ec1'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:31.255899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1248/2517] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:30 2022] DELETE /identity/v3/users/133f980f2bc14230a340495b63c75ec1 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:32.176250 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:32.177897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:32.206092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc16d1-cb83-4c06-b305-33988d68d7a9 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:32.320208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:32.321154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:32.321599 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:32.322037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] PATH_INFO: `/v3/projects/f0de772b05c14d05afe876314e5e06a6` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:32.323187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0de772b05c14d05afe876314e5e06a6)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:32.325203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:32.361885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:32.468296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0de772b05c14d05afe876314e5e06a6', 'request_id': 'req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:32.563975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0de772b05c14d05afe876314e5e06a6', 'request_id': 'req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:32.583890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0de772b05c14d05afe876314e5e06a6', 'request_id': 'req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:32.606729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] The token cache is being invalidate because project f0de772b05c14d05afe876314e5e06a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:32.607148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:32.616164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-3bb0e93b-9b6a-477e-a476-9b10fe808cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:32.618524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1270/2518] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:32 2022] DELETE /identity/v3/projects/f0de772b05c14d05afe876314e5e06a6 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:32.623894 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acedd6a-660f-419c-acaa-65de0c7e5660 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:32.624830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acedd6a-660f-419c-acaa-65de0c7e5660 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:32.625498 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acedd6a-660f-419c-acaa-65de0c7e5660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:32.666113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8acedd6a-660f-419c-acaa-65de0c7e5660 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:32.669415 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8acedd6a-660f-419c-acaa-65de0c7e5660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:32.843337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1249/2519] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:32.845570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ceaa4-6e98-4e6e-9481-7b68fdae8f86 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:32.845570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ceaa4-6e98-4e6e-9481-7b68fdae8f86 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:32.845786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ceaa4-6e98-4e6e-9481-7b68fdae8f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:32.876445 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5b5ceaa4-6e98-4e6e-9481-7b68fdae8f86 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:32.897895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5b5ceaa4-6e98-4e6e-9481-7b68fdae8f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:32.897895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1271/2520] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:32.901615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acedd6a-660f-419c-acaa-65de0c7e5660 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:32.912728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acedd6a-660f-419c-acaa-65de0c7e5660 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:32.917897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd824-5f12-40eb-939f-46f5e44bcf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:32.918512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd824-5f12-40eb-939f-46f5e44bcf39 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:32.918794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd824-5f12-40eb-939f-46f5e44bcf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:32.919067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd824-5f12-40eb-939f-46f5e44bcf39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:32.919754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd824-5f12-40eb-939f-46f5e44bcf39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:32.920060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd824-5f12-40eb-939f-46f5e44bcf39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:32.921643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd824-5f12-40eb-939f-46f5e44bcf39 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:32.934182 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1250/2521] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:24:32.938645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ceaa4-6e98-4e6e-9481-7b68fdae8f86 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:32.948791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ceaa4-6e98-4e6e-9481-7b68fdae8f86 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:32.953788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95298-0981-4ab2-b0b7-62ca07867f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:32.954441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95298-0981-4ab2-b0b7-62ca07867f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:32.954749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95298-0981-4ab2-b0b7-62ca07867f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:32.955010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95298-0981-4ab2-b0b7-62ca07867f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:32.956020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba95298-0981-4ab2-b0b7-62ca07867f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:32.958066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba95298-0981-4ab2-b0b7-62ca07867f17 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:33.115253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1272/2522] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:32 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:33.121107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd824-5f12-40eb-939f-46f5e44bcf39 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:33.139814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd824-5f12-40eb-939f-46f5e44bcf39 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:33.233240 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a993f98-3eb0-4f2d-b162-5f8480150a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:33.233917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a993f98-3eb0-4f2d-b162-5f8480150a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:33.234228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a993f98-3eb0-4f2d-b162-5f8480150a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:33.234519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a993f98-3eb0-4f2d-b162-5f8480150a81 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:33.235199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a993f98-3eb0-4f2d-b162-5f8480150a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:33.242961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a993f98-3eb0-4f2d-b162-5f8480150a81 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:33.384388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1251/2523] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:33 2022] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:33.385620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95298-0981-4ab2-b0b7-62ca07867f17 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:33.405893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95298-0981-4ab2-b0b7-62ca07867f17 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:33.411260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57dbb-d27d-4fab-89f0-42f543bf463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:33.411937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57dbb-d27d-4fab-89f0-42f543bf463e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:33.412374 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57dbb-d27d-4fab-89f0-42f543bf463e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:33.412659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57dbb-d27d-4fab-89f0-42f543bf463e admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:33.413314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc57dbb-d27d-4fab-89f0-42f543bf463e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:33.415240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc57dbb-d27d-4fab-89f0-42f543bf463e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:33.426976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1273/2524] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:33.431231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a993f98-3eb0-4f2d-b162-5f8480150a81 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:33.446710 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a993f98-3eb0-4f2d-b162-5f8480150a81 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:33.457478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82b208-d2a9-4700-be6a-67cc2299eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:33.458238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82b208-d2a9-4700-be6a-67cc2299eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:33.458683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82b208-d2a9-4700-be6a-67cc2299eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:33.458875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82b208-d2a9-4700-be6a-67cc2299eb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:33.459685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82b208-d2a9-4700-be6a-67cc2299eb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:33.461955 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82b208-d2a9-4700-be6a-67cc2299eb09 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:33.473985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1252/2525] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:33.478399 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57dbb-d27d-4fab-89f0-42f543bf463e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:33.491548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57dbb-d27d-4fab-89f0-42f543bf463e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:33.496553 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25aa57-41b6-447c-acd8-72c6de070e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:33.497254 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25aa57-41b6-447c-acd8-72c6de070e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:33.497540 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25aa57-41b6-447c-acd8-72c6de070e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:33.497824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25aa57-41b6-447c-acd8-72c6de070e8d admin admin] PATH_INFO: `/v3/projects/e359470187194dd29c80cf66e9eeeb55/users/cbe2ea7610724cfabc1695c9ab429ae7/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:33.537127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25aa57-41b6-447c-acd8-72c6de070e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e359470187194dd29c80cf66e9eeeb55, user_id=cbe2ea7610724cfabc1695c9ab429ae7, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:33.540673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25aa57-41b6-447c-acd8-72c6de070e8d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:33.724206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1274/2526] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:33 2022] PUT /identity/v3/projects/e359470187194dd29c80cf66e9eeeb55/users/cbe2ea7610724cfabc1695c9ab429ae7/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:33.734441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3600-d302-421c-949d-0e78eeb7a3ee None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:33.735472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3600-d302-421c-949d-0e78eeb7a3ee None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:33.735801 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3600-d302-421c-949d-0e78eeb7a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:33.809465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6ade3600-d302-421c-949d-0e78eeb7a3ee None None] MFA Rules not processed for user `cbe2ea7610724cfabc1695c9ab429ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:33.810856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6ade3600-d302-421c-949d-0e78eeb7a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:33.907551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:33.941559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1253/2527] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:33.942928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25aa57-41b6-447c-acd8-72c6de070e8d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:34.089914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25aa57-41b6-447c-acd8-72c6de070e8d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:34.097052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634fd31-ef76-4fd0-b3c5-9e58583960ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:34.099771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634fd31-ef76-4fd0-b3c5-9e58583960ef admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:34.099771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634fd31-ef76-4fd0-b3c5-9e58583960ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:34.099771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634fd31-ef76-4fd0-b3c5-9e58583960ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:34.099771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634fd31-ef76-4fd0-b3c5-9e58583960ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:34.100837 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634fd31-ef76-4fd0-b3c5-9e58583960ef admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:34.134101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3600-d302-421c-949d-0e78eeb7a3ee None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:34.136291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6ade3600-d302-421c-949d-0e78eeb7a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:34.153287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3600-d302-421c-949d-0e78eeb7a3ee None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:34.158333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:34.158985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:34.159262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:34.159538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] PATH_INFO: `/v3/users/be0f76350dc148c6b51705693a1902c4` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:34.160893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0f76350dc148c6b51705693a1902c4)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:34.163492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:34.243798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1275/2528] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:33 2022] POST /identity/v3/projects => generated 383 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:34.245930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634fd31-ef76-4fd0-b3c5-9e58583960ef admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:34.283010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:34.315326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634fd31-ef76-4fd0-b3c5-9e58583960ef admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:34.320536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fac3a-8077-46a6-a128-c8a67574b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:34.321153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fac3a-8077-46a6-a128-c8a67574b54a admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:34.321436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fac3a-8077-46a6-a128-c8a67574b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:34.321738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fac3a-8077-46a6-a128-c8a67574b54a admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:34.322353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fac3a-8077-46a6-a128-c8a67574b54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:34.324396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fac3a-8077-46a6-a128-c8a67574b54a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:34.404394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0f76350dc148c6b51705693a1902c4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:34.601305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1276/2529] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:34 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:34.602355 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fac3a-8077-46a6-a128-c8a67574b54a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:34.612848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fac3a-8077-46a6-a128-c8a67574b54a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:34.618739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce1dd9-8b98-409d-b9ae-f863b2c3ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:34.619350 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce1dd9-8b98-409d-b9ae-f863b2c3ce0e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:34.620237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce1dd9-8b98-409d-b9ae-f863b2c3ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:34.620518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce1dd9-8b98-409d-b9ae-f863b2c3ce0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:34.621192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce1dd9-8b98-409d-b9ae-f863b2c3ce0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:34.622770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce1dd9-8b98-409d-b9ae-f863b2c3ce0e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:34.633592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1277/2530] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:34.637627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce1dd9-8b98-409d-b9ae-f863b2c3ce0e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:34.646885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0f76350dc148c6b51705693a1902c4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:34.649187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce1dd9-8b98-409d-b9ae-f863b2c3ce0e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:34.655273 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533a4b-7de7-4c96-bb0b-2b717b5cc321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:34.656053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533a4b-7de7-4c96-bb0b-2b717b5cc321 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:34.656606 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533a4b-7de7-4c96-bb0b-2b717b5cc321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:34.656928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533a4b-7de7-4c96-bb0b-2b717b5cc321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:34.657563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533a4b-7de7-4c96-bb0b-2b717b5cc321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:34.659109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533a4b-7de7-4c96-bb0b-2b717b5cc321 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:34.662490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0f76350dc148c6b51705693a1902c4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:34.663276 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0f76350dc148c6b51705693a1902c4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:34.672968 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1278/2531] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:34.677204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533a4b-7de7-4c96-bb0b-2b717b5cc321 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:34.678446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e2e6bc89-68c2-4035-9aef-81a42442cb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0f76350dc148c6b51705693a1902c4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:34.678918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2b533a4b-7de7-4c96-bb0b-2b717b5cc321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:34.684491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1254/2532] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:34 2022] DELETE /identity/v3/users/be0f76350dc148c6b51705693a1902c4 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:34.691794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533a4b-7de7-4c96-bb0b-2b717b5cc321 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:34.761238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1318e-2dca-4756-9f98-e5d8b9b8d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:34.762218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1318e-2dca-4756-9f98-e5d8b9b8d71b admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:34.762506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1318e-2dca-4756-9f98-e5d8b9b8d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:34.762785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1318e-2dca-4756-9f98-e5d8b9b8d71b admin admin] PATH_INFO: `/v3/projects/beef24574bf54d8e8a9e63343efc0cba/users/e027b4ec1f3a419286eac5c453c6a0e4/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:34.779798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1318e-2dca-4756-9f98-e5d8b9b8d71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=beef24574bf54d8e8a9e63343efc0cba, user_id=e027b4ec1f3a419286eac5c453c6a0e4, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:34.782615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1318e-2dca-4756-9f98-e5d8b9b8d71b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:34.908032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1279/2533] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:34 2022] PUT /identity/v3/projects/beef24574bf54d8e8a9e63343efc0cba/users/e027b4ec1f3a419286eac5c453c6a0e4/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:34.920322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fd6e5-78fc-486c-a02c-46db1b90bf31 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:34.920893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fd6e5-78fc-486c-a02c-46db1b90bf31 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:34.921188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fd6e5-78fc-486c-a02c-46db1b90bf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:34.950680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d20fd6e5-78fc-486c-a02c-46db1b90bf31 None None] MFA Rules not processed for user `e027b4ec1f3a419286eac5c453c6a0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:34.951945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d20fd6e5-78fc-486c-a02c-46db1b90bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:35.005913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1318e-2dca-4756-9f98-e5d8b9b8d71b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.008058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3ee1318e-2dca-4756-9f98-e5d8b9b8d71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:35.039526 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1255/2534] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:35.053895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fd6e5-78fc-486c-a02c-46db1b90bf31 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.130513 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1318e-2dca-4756-9f98-e5d8b9b8d71b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.137194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.138382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.139820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.141026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] PATH_INFO: `/v3/projects/689698d187974bd1ba50e44be080a6f5` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.142721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689698d187974bd1ba50e44be080a6f5)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.144654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.153331 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:35.175744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fd6e5-78fc-486c-a02c-46db1b90bf31 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.180149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:35.183076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29eade-ca28-41cc-9efe-2eef41194703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.184091 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29eade-ca28-41cc-9efe-2eef41194703 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.184438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29eade-ca28-41cc-9efe-2eef41194703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.184718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29eade-ca28-41cc-9efe-2eef41194703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.185386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29eade-ca28-41cc-9efe-2eef41194703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.187352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29eade-ca28-41cc-9efe-2eef41194703 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.289212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1256/2535] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:35 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:35.295883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29eade-ca28-41cc-9efe-2eef41194703 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.330509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689698d187974bd1ba50e44be080a6f5', 'request_id': 'req-18fcf458-7764-4a44-9dce-15e5ea8b5357'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:35.372976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29eade-ca28-41cc-9efe-2eef41194703 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.380093 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1db54b-db96-4bae-b1c8-29cfaf8be2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.380617 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689698d187974bd1ba50e44be080a6f5', 'request_id': 'req-18fcf458-7764-4a44-9dce-15e5ea8b5357'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:35.382942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1db54b-db96-4bae-b1c8-29cfaf8be2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.382942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1db54b-db96-4bae-b1c8-29cfaf8be2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.382942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1db54b-db96-4bae-b1c8-29cfaf8be2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.382942 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1db54b-db96-4bae-b1c8-29cfaf8be2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.386469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1db54b-db96-4bae-b1c8-29cfaf8be2b6 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.391800 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689698d187974bd1ba50e44be080a6f5', 'request_id': 'req-18fcf458-7764-4a44-9dce-15e5ea8b5357'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:35.409623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] The token cache is being invalidate because project 689698d187974bd1ba50e44be080a6f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:35.411614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:35.411614 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-18fcf458-7764-4a44-9dce-15e5ea8b5357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:35.412284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1280/2536] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:35 2022] DELETE /identity/v3/projects/689698d187974bd1ba50e44be080a6f5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:35.418220 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186897-7b56-42db-87c0-4ad37abe63b3 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.418829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186897-7b56-42db-87c0-4ad37abe63b3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.419307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186897-7b56-42db-87c0-4ad37abe63b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.441329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-eb186897-7b56-42db-87c0-4ad37abe63b3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:35.443148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-eb186897-7b56-42db-87c0-4ad37abe63b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:35.455026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1281/2537] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:35.464016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f3397-31bf-43f5-9352-f112d640560b None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.468872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f3397-31bf-43f5-9352-f112d640560b None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.468872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f3397-31bf-43f5-9352-f112d640560b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.486269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-7d2f3397-31bf-43f5-9352-f112d640560b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:35.487761 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7d2f3397-31bf-43f5-9352-f112d640560b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:35.497406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1282/2538] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:35.503018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f3397-31bf-43f5-9352-f112d640560b None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.512551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f3397-31bf-43f5-9352-f112d640560b None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.518392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.519008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.519285 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.519556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.520246 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:35.520565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.522266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.544870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1257/2539] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:35 2022] POST /identity/v3/users => generated 299 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:35.545181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1283/2540] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:24:35.545352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1db54b-db96-4bae-b1c8-29cfaf8be2b6 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.545966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.547704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:35.561500 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334716de-7389-4c6b-890d-d95db4173805 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.563371 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1db54b-db96-4bae-b1c8-29cfaf8be2b6 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.567062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5107a1-d70b-4d3b-9773-1715a95b23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.570758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a62ff-d9e1-4bd5-9e9e-1e38f6541ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.571050 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5107a1-d70b-4d3b-9773-1715a95b23f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.571338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5107a1-d70b-4d3b-9773-1715a95b23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.571636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5107a1-d70b-4d3b-9773-1715a95b23f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.571749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a62ff-d9e1-4bd5-9e9e-1e38f6541ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.572179 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a62ff-d9e1-4bd5-9e9e-1e38f6541ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.572288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5107a1-d70b-4d3b-9773-1715a95b23f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.572674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a62ff-d9e1-4bd5-9e9e-1e38f6541ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.573837 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a62ff-d9e1-4bd5-9e9e-1e38f6541ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.574155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5107a1-d70b-4d3b-9773-1715a95b23f2 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.577223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a62ff-d9e1-4bd5-9e9e-1e38f6541ad9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.587656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1284/2541] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:35.591671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5107a1-d70b-4d3b-9773-1715a95b23f2 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.603109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5107a1-d70b-4d3b-9773-1715a95b23f2 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.609905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd01e-15fc-4c53-87d4-2141e1a13a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.614452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd01e-15fc-4c53-87d4-2141e1a13a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.614452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd01e-15fc-4c53-87d4-2141e1a13a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.614452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd01e-15fc-4c53-87d4-2141e1a13a80 admin admin] PATH_INFO: `/v3/projects/8023f82bfb8145acbe4d431fd332459b/users/6911465392ce46acb2a7de2778c88e76/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.637319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bd01e-15fc-4c53-87d4-2141e1a13a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8023f82bfb8145acbe4d431fd332459b, user_id=6911465392ce46acb2a7de2778c88e76, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.640084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bd01e-15fc-4c53-87d4-2141e1a13a80 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.725188 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1258/2542] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:35 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:35.726363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a62ff-d9e1-4bd5-9e9e-1e38f6541ad9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.748922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1285/2543] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:35 2022] PUT /identity/v3/projects/8023f82bfb8145acbe4d431fd332459b/users/6911465392ce46acb2a7de2778c88e76/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:35.754781 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd01e-15fc-4c53-87d4-2141e1a13a80 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.827974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a62ff-d9e1-4bd5-9e9e-1e38f6541ad9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.877527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd01e-15fc-4c53-87d4-2141e1a13a80 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.888184 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7544-2836-449c-ad11-977fc39d8b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.890851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7544-2836-449c-ad11-977fc39d8b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.892177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7544-2836-449c-ad11-977fc39d8b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.892646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:35.893212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7544-2836-449c-ad11-977fc39d8b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.895715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf7544-2836-449c-ad11-977fc39d8b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.897952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf7544-2836-449c-ad11-977fc39d8b00 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.920234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e46df9-1890-4dc7-bfb6-52a9ef917bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.920941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e46df9-1890-4dc7-bfb6-52a9ef917bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.921504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e46df9-1890-4dc7-bfb6-52a9ef917bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.921504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e46df9-1890-4dc7-bfb6-52a9ef917bfb admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.922387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e46df9-1890-4dc7-bfb6-52a9ef917bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.924599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e46df9-1890-4dc7-bfb6-52a9ef917bfb admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.926214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1286/2544] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:35.930238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7544-2836-449c-ad11-977fc39d8b00 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:35.946443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7544-2836-449c-ad11-977fc39d8b00 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:35.952911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59071de4-6411-4169-8aad-21d3edb4b29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:35.953663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59071de4-6411-4169-8aad-21d3edb4b29a admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.954088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59071de4-6411-4169-8aad-21d3edb4b29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.954369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59071de4-6411-4169-8aad-21d3edb4b29a admin admin] PATH_INFO: `/v3/projects/8023f82bfb8145acbe4d431fd332459b/users/6911465392ce46acb2a7de2778c88e76/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:35.959676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59071de4-6411-4169-8aad-21d3edb4b29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8023f82bfb8145acbe4d431fd332459b, user_id=6911465392ce46acb2a7de2778c88e76, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:35.964493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59071de4-6411-4169-8aad-21d3edb4b29a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:35.989496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1287/2545] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:35 2022] PUT /identity/v3/projects/8023f82bfb8145acbe4d431fd332459b/users/6911465392ce46acb2a7de2778c88e76/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:35.991091 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b363c58-47d7-4f68-b1c6-90b826498453 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:35.996020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b363c58-47d7-4f68-b1c6-90b826498453 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:35.996020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b363c58-47d7-4f68-b1c6-90b826498453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:36.026905 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-2b363c58-47d7-4f68-b1c6-90b826498453 None None] MFA Rules not processed for user `6911465392ce46acb2a7de2778c88e76`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:36.028584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2b363c58-47d7-4f68-b1c6-90b826498453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:36.053857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:36.064744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1259/2546] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:35 2022] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:36.069174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e46df9-1890-4dc7-bfb6-52a9ef917bfb admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:36.081229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e46df9-1890-4dc7-bfb6-52a9ef917bfb admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:36.132530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1288/2547] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:36.142618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b363c58-47d7-4f68-b1c6-90b826498453 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:36.144659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2b363c58-47d7-4f68-b1c6-90b826498453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:36.170764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb72cf-786e-4db1-994a-21f57662eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:36.171435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb72cf-786e-4db1-994a-21f57662eebe admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:36.171903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb72cf-786e-4db1-994a-21f57662eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:36.172042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb72cf-786e-4db1-994a-21f57662eebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:36.172669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb72cf-786e-4db1-994a-21f57662eebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:36.174290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb72cf-786e-4db1-994a-21f57662eebe admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:36.192760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1260/2548] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:36.198914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb72cf-786e-4db1-994a-21f57662eebe admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:36.213772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb72cf-786e-4db1-994a-21f57662eebe admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:36.215968 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b363c58-47d7-4f68-b1c6-90b826498453 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:36.219818 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3deedb-24db-4fd9-9741-b9ebefa6c4ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:36.220525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3deedb-24db-4fd9-9741-b9ebefa6c4ba service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:36.220643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74195406-8000-454a-a694-30613ccc6d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:36.220790 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3deedb-24db-4fd9-9741-b9ebefa6c4ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:36.221134 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3deedb-24db-4fd9-9741-b9ebefa6c4ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:36.221386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74195406-8000-454a-a694-30613ccc6d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:36.221744 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74195406-8000-454a-a694-30613ccc6d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:36.222013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74195406-8000-454a-a694-30613ccc6d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:36.222679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74195406-8000-454a-a694-30613ccc6d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:36.223223 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2e3deedb-24db-4fd9-9741-b9ebefa6c4ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:36.224272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74195406-8000-454a-a694-30613ccc6d0e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:36.235672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1261/2549] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:36.246482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74195406-8000-454a-a694-30613ccc6d0e admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:36.256903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74195406-8000-454a-a694-30613ccc6d0e admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:36.264462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18558075-b232-46db-adbe-3a76564e3d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:36.264462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18558075-b232-46db-adbe-3a76564e3d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:36.265080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18558075-b232-46db-adbe-3a76564e3d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:36.265433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18558075-b232-46db-adbe-3a76564e3d52 admin admin] PATH_INFO: `/v3/projects/95a5be97615d49c4bc592f392899d19c/users/e6620cb0c8b146d396495a92b2f17198/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:36.281606 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18558075-b232-46db-adbe-3a76564e3d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a5be97615d49c4bc592f392899d19c, user_id=e6620cb0c8b146d396495a92b2f17198, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:36.284425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18558075-b232-46db-adbe-3a76564e3d52 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:36.294736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3deedb-24db-4fd9-9741-b9ebefa6c4ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:36.296202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3deedb-24db-4fd9-9741-b9ebefa6c4ba service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:36.305736 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1289/2550] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:36.391014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1262/2551] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:36 2022] PUT /identity/v3/projects/95a5be97615d49c4bc592f392899d19c/users/e6620cb0c8b146d396495a92b2f17198/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:36.399111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712404a-92e2-4334-8f8c-f8b6e2c91dcd None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:36.399401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712404a-92e2-4334-8f8c-f8b6e2c91dcd None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:36.399753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712404a-92e2-4334-8f8c-f8b6e2c91dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:36.436939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f712404a-92e2-4334-8f8c-f8b6e2c91dcd None None] MFA Rules not processed for user `e6620cb0c8b146d396495a92b2f17198`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:36.438347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f712404a-92e2-4334-8f8c-f8b6e2c91dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:36.529463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1290/2552] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:36.545262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18558075-b232-46db-adbe-3a76564e3d52 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:36.546979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-18558075-b232-46db-adbe-3a76564e3d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:36.624075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18558075-b232-46db-adbe-3a76564e3d52 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:36.630174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1ee30-f10a-4362-b0e8-e1e2ac352f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4971acb91bbf498887606c5ba5d00176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:36.630833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1ee30-f10a-4362-b0e8-e1e2ac352f0a service nova] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:36.631119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1ee30-f10a-4362-b0e8-e1e2ac352f0a service nova] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:36.631398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1ee30-f10a-4362-b0e8-e1e2ac352f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:36.639568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1ee30-f10a-4362-b0e8-e1e2ac352f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:36.641167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1ee30-f10a-4362-b0e8-e1e2ac352f0a service nova] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:36.650217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1263/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:38.312897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712404a-92e2-4334-8f8c-f8b6e2c91dcd None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:38.314403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f712404a-92e2-4334-8f8c-f8b6e2c91dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:38.319713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:38.377834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712404a-92e2-4334-8f8c-f8b6e2c91dcd None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:38.382266 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ef053-c2f6-42ef-aae1-04c83af61a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:38.382989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ef053-c2f6-42ef-aae1-04c83af61a74 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:38.383488 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ef053-c2f6-42ef-aae1-04c83af61a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:38.383710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ef053-c2f6-42ef-aae1-04c83af61a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:38.385528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-eb7ef053-c2f6-42ef-aae1-04c83af61a74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:38.469144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ef053-c2f6-42ef-aae1-04c83af61a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:38.470727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ef053-c2f6-42ef-aae1-04c83af61a74 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:38.485537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1291/2554] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:39.843698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1ee30-f10a-4362-b0e8-e1e2ac352f0a service nova] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:39.879938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:39.944062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1ee30-f10a-4362-b0e8-e1e2ac352f0a service nova] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:39.949790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:39.950446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:39.950725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:39.951000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] PATH_INFO: `/v3/users/e6620cb0c8b146d396495a92b2f17198` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:39.952468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6620cb0c8b146d396495a92b2f17198)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:39.955032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:39.973720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ef053-c2f6-42ef-aae1-04c83af61a74 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:39.984835 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ef053-c2f6-42ef-aae1-04c83af61a74 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:39.990627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72769b77-eb44-423d-89e3-64ca08a29869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:39.991456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769b77-eb44-423d-89e3-64ca08a29869 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:39.991885 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769b77-eb44-423d-89e3-64ca08a29869 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:39.992464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769b77-eb44-423d-89e3-64ca08a29869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:40.071092 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72769b77-eb44-423d-89e3-64ca08a29869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:40.072645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72769b77-eb44-423d-89e3-64ca08a29869 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:40.082968 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1292/2555] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:24:40.241018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72769b77-eb44-423d-89e3-64ca08a29869 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:40.243372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-72769b77-eb44-423d-89e3-64ca08a29869 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:40.256530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72769b77-eb44-423d-89e3-64ca08a29869 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:40.262215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:40.262861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:40.263145 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:40.263427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] PATH_INFO: `/v3/users/ee63cb1d8f2845c2bc171faa38c99aee` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:40.264671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee63cb1d8f2845c2bc171faa38c99aee)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:40.266906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:40.294287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6620cb0c8b146d396495a92b2f17198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.352452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6620cb0c8b146d396495a92b2f17198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.367970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6620cb0c8b146d396495a92b2f17198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.368608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6620cb0c8b146d396495a92b2f17198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.376424 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c212947a-c996-461b-85af-3b9cc5c04c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6620cb0c8b146d396495a92b2f17198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.382266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1264/2556] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:39 2022] DELETE /identity/v3/users/e6620cb0c8b146d396495a92b2f17198 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:40.387261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a26a-f0d9-4e08-8d2d-623bc4f7c628 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:40.387696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a26a-f0d9-4e08-8d2d-623bc4f7c628 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:40.388202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a26a-f0d9-4e08-8d2d-623bc4f7c628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:40.412791 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d731a26a-f0d9-4e08-8d2d-623bc4f7c628 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:40.412791 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d731a26a-f0d9-4e08-8d2d-623bc4f7c628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:40.452214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:40.456163 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee63cb1d8f2845c2bc171faa38c99aee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.457194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee63cb1d8f2845c2bc171faa38c99aee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.485379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1265/2557] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:40.493404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a26a-f0d9-4e08-8d2d-623bc4f7c628 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:40.495120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d731a26a-f0d9-4e08-8d2d-623bc4f7c628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:40.512663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee63cb1d8f2845c2bc171faa38c99aee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.513447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee63cb1d8f2845c2bc171faa38c99aee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.522353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee63cb1d8f2845c2bc171faa38c99aee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:40.545056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1293/2558] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:40 2022] DELETE /identity/v3/users/ee63cb1d8f2845c2bc171faa38c99aee => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:40.549233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:40.564002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a26a-f0d9-4e08-8d2d-623bc4f7c628 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:40.621662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea364a-ee8b-45df-a785-15e2ff4855c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:40.622336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea364a-ee8b-45df-a785-15e2ff4855c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:40.622619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea364a-ee8b-45df-a785-15e2ff4855c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:40.622893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea364a-ee8b-45df-a785-15e2ff4855c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:40.624799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-dfea364a-ee8b-45df-a785-15e2ff4855c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:40.688990 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea364a-ee8b-45df-a785-15e2ff4855c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:40.690735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea364a-ee8b-45df-a785-15e2ff4855c6 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:40.702158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1266/2559] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:24:40.828887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:40.830446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:40.845356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11137cf-68b1-47a0-867d-60926d0592a8 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:40.852225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:40.852225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:40.852225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:40.852225 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] PATH_INFO: `/v3/projects/99462c2b81c545519c2f9d2d6d312135` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:40.853104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99462c2b81c545519c2f9d2d6d312135)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:40.855227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:41.009084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99462c2b81c545519c2f9d2d6d312135', 'request_id': 'req-cf64295e-7c0c-48de-beeb-398db40ba06c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.124404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99462c2b81c545519c2f9d2d6d312135', 'request_id': 'req-cf64295e-7c0c-48de-beeb-398db40ba06c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.132168 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99462c2b81c545519c2f9d2d6d312135', 'request_id': 'req-cf64295e-7c0c-48de-beeb-398db40ba06c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.143172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] The token cache is being invalidate because project 99462c2b81c545519c2f9d2d6d312135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:41.143464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.144150 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.145624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1294/2560] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:40 2022] DELETE /identity/v3/projects/99462c2b81c545519c2f9d2d6d312135 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:41.149675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea364a-ee8b-45df-a785-15e2ff4855c6 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:41.160030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:41.161473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:41.162017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea364a-ee8b-45df-a785-15e2ff4855c6 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:41.231942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64295e-7c0c-48de-beeb-398db40ba06c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:41.237259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:41.239411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:41.239411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:41.239411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] PATH_INFO: `/v3/projects/95a5be97615d49c4bc592f392899d19c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:41.240526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a5be97615d49c4bc592f392899d19c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:41.242565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:41.242752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:41.243816 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:41.244227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:41.244640 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] PATH_INFO: `/v3/users/99cc8da91d4044daacd4df60bcf80750` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:41.246019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cc8da91d4044daacd4df60bcf80750)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:41.248048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:41.355271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:41.359808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a5be97615d49c4bc592f392899d19c', 'request_id': 'req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.501528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a5be97615d49c4bc592f392899d19c', 'request_id': 'req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.512053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a5be97615d49c4bc592f392899d19c', 'request_id': 'req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.519512 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cc8da91d4044daacd4df60bcf80750'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.523553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:41.529636 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] The token cache is being invalidate because project 95a5be97615d49c4bc592f392899d19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:41.530498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.530871 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-4e80ffc4-4ece-46ad-8f0b-efab3d9ec5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.532436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1295/2561] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:41 2022] DELETE /identity/v3/projects/95a5be97615d49c4bc592f392899d19c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:41.539034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6bfb6-074a-4b55-a72c-ebad557b0dea None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:41.539310 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6bfb6-074a-4b55-a72c-ebad557b0dea None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:41.539585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6bfb6-074a-4b55-a72c-ebad557b0dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:41.561164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-0bf6bfb6-074a-4b55-a72c-ebad557b0dea None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:41.562381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0bf6bfb6-074a-4b55-a72c-ebad557b0dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:41.609303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cc8da91d4044daacd4df60bcf80750'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.626146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cc8da91d4044daacd4df60bcf80750'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.626345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1296/2562] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:41.630733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cc8da91d4044daacd4df60bcf80750'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.632916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd59d75-ea66-40d5-9b4c-4005c8fa175c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:41.633407 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd59d75-ea66-40d5-9b4c-4005c8fa175c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:41.633549 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd59d75-ea66-40d5-9b4c-4005c8fa175c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:41.639336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cc8da91d4044daacd4df60bcf80750'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:41.646979 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1267/2563] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:41 2022] DELETE /identity/v3/users/99cc8da91d4044daacd4df60bcf80750 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:41.654502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-abd59d75-ea66-40d5-9b4c-4005c8fa175c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:41.655809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-abd59d75-ea66-40d5-9b4c-4005c8fa175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:41.731015 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1297/2564] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:41.733275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:41.758707 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822390f4-a5b7-4320-ac97-713c4c4d6633 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:41.766347 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786d0e0-9b49-461d-b58e-bf121737d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:41.767757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786d0e0-9b49-461d-b58e-bf121737d39f admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:41.768042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786d0e0-9b49-461d-b58e-bf121737d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:41.768854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786d0e0-9b49-461d-b58e-bf121737d39f admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:41.770220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786d0e0-9b49-461d-b58e-bf121737d39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:41.770601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786d0e0-9b49-461d-b58e-bf121737d39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:41.775939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786d0e0-9b49-461d-b58e-bf121737d39f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:41.791044 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1268/2565] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:24:41.796377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd59d75-ea66-40d5-9b4c-4005c8fa175c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:41.806764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd59d75-ea66-40d5-9b4c-4005c8fa175c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:41.812244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc8d8f-f45f-4ddc-ad41-84e33ecca784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:41.812829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc8d8f-f45f-4ddc-ad41-84e33ecca784 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:41.813111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc8d8f-f45f-4ddc-ad41-84e33ecca784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:41.813446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc8d8f-f45f-4ddc-ad41-84e33ecca784 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:41.814082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc8d8f-f45f-4ddc-ad41-84e33ecca784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:41.816037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc8d8f-f45f-4ddc-ad41-84e33ecca784 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:41.913404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1298/2566] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:41 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:41.917770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786d0e0-9b49-461d-b58e-bf121737d39f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:41.927950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786d0e0-9b49-461d-b58e-bf121737d39f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:41.992581 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc8d8f-f45f-4ddc-ad41-84e33ecca784 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:41.994396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9fbc8d8f-f45f-4ddc-ad41-84e33ecca784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:42.006122 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7928a4a-551f-44c9-bcc2-754b6eb16364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.007289 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7928a4a-551f-44c9-bcc2-754b6eb16364 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.009936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7928a4a-551f-44c9-bcc2-754b6eb16364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.010733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7928a4a-551f-44c9-bcc2-754b6eb16364 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.012300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7928a4a-551f-44c9-bcc2-754b6eb16364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.015427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7928a4a-551f-44c9-bcc2-754b6eb16364 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.061491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:42.066720 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc8d8f-f45f-4ddc-ad41-84e33ecca784 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.071747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.075692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.075692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.075692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] PATH_INFO: `/v3/projects/0a8000e71d084e408860a400873ac8d6` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.075692 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8000e71d084e408860a400873ac8d6)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.076655 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.112733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1269/2567] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:41 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:42.117521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7928a4a-551f-44c9-bcc2-754b6eb16364 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.133235 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7928a4a-551f-44c9-bcc2-754b6eb16364 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.138601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c67e4-9710-4f8f-a01a-c664f5a8c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.139291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c67e4-9710-4f8f-a01a-c664f5a8c9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.139662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c67e4-9710-4f8f-a01a-c664f5a8c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.140011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c67e4-9710-4f8f-a01a-c664f5a8c9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.140782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c67e4-9710-4f8f-a01a-c664f5a8c9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.142518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c67e4-9710-4f8f-a01a-c664f5a8c9e4 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.156172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1270/2568] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:42.159209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c67e4-9710-4f8f-a01a-c664f5a8c9e4 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.176461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c67e4-9710-4f8f-a01a-c664f5a8c9e4 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.181278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6ae3a-5bf1-4b86-928e-13aea7f1bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.183892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6ae3a-5bf1-4b86-928e-13aea7f1bef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.183892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6ae3a-5bf1-4b86-928e-13aea7f1bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.183892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6ae3a-5bf1-4b86-928e-13aea7f1bef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.183892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6ae3a-5bf1-4b86-928e-13aea7f1bef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.184940 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6ae3a-5bf1-4b86-928e-13aea7f1bef6 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.195949 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1271/2569] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:42.200239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6ae3a-5bf1-4b86-928e-13aea7f1bef6 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.218555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6ae3a-5bf1-4b86-928e-13aea7f1bef6 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.218555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3cdf1-fa35-402c-ad5b-75f33a229e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.218555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3cdf1-fa35-402c-ad5b-75f33a229e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.218555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3cdf1-fa35-402c-ad5b-75f33a229e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.219085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3cdf1-fa35-402c-ad5b-75f33a229e5d admin admin] PATH_INFO: `/v3/projects/29504c15aecb4f0fa4c0b35ea661682b/users/12b115c5155947dea3ea7bf7dc15dd72/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.232686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3cdf1-fa35-402c-ad5b-75f33a229e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29504c15aecb4f0fa4c0b35ea661682b, user_id=12b115c5155947dea3ea7bf7dc15dd72, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.235370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3cdf1-fa35-402c-ad5b-75f33a229e5d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.336883 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1272/2570] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:42 2022] PUT /identity/v3/projects/29504c15aecb4f0fa4c0b35ea661682b/users/12b115c5155947dea3ea7bf7dc15dd72/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:42.346689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8000e71d084e408860a400873ac8d6', 'request_id': 'req-b287706a-93a4-475b-b246-4dc144b0a714'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:42.347731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0db9c-a39a-44d1-9a7f-6ba763a93166 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.348023 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0db9c-a39a-44d1-9a7f-6ba763a93166 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.348304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0db9c-a39a-44d1-9a7f-6ba763a93166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.378059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ded0db9c-a39a-44d1-9a7f-6ba763a93166 None None] MFA Rules not processed for user `12b115c5155947dea3ea7bf7dc15dd72`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:42.379669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ded0db9c-a39a-44d1-9a7f-6ba763a93166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:42.408862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8000e71d084e408860a400873ac8d6', 'request_id': 'req-b287706a-93a4-475b-b246-4dc144b0a714'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:42.415808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8000e71d084e408860a400873ac8d6', 'request_id': 'req-b287706a-93a4-475b-b246-4dc144b0a714'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:42.427484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] The token cache is being invalidate because project 0a8000e71d084e408860a400873ac8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:42.427805 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:42.428489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-b287706a-93a4-475b-b246-4dc144b0a714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:42.429984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1299/2571] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:41 2022] DELETE /identity/v3/projects/0a8000e71d084e408860a400873ac8d6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:42.435699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690f793-732d-46ed-a8e0-1e1afc221633 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.436061 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690f793-732d-46ed-a8e0-1e1afc221633 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.436408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690f793-732d-46ed-a8e0-1e1afc221633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.444658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1273/2572] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:42.451042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0db9c-a39a-44d1-9a7f-6ba763a93166 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.452635 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ded0db9c-a39a-44d1-9a7f-6ba763a93166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:42.460865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-4690f793-732d-46ed-a8e0-1e1afc221633 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:42.462113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4690f793-732d-46ed-a8e0-1e1afc221633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:42.528065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0db9c-a39a-44d1-9a7f-6ba763a93166 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.534909 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1300/2573] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:42.535096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd7a74-0be9-4119-bf36-dbab0257a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.535096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd7a74-0be9-4119-bf36-dbab0257a075 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.535096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd7a74-0be9-4119-bf36-dbab0257a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.535096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd7a74-0be9-4119-bf36-dbab0257a075 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.535476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd7a74-0be9-4119-bf36-dbab0257a075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.536427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d79c-c863-4f99-9950-33ac692dc9f2 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.536712 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d79c-c863-4f99-9950-33ac692dc9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.536970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd7a74-0be9-4119-bf36-dbab0257a075 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.537089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d79c-c863-4f99-9950-33ac692dc9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.544792 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:42.558007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-c145d79c-c863-4f99-9950-33ac692dc9f2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:42.559217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c145d79c-c863-4f99-9950-33ac692dc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:42.567666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1301/2574] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:42.571895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d79c-c863-4f99-9950-33ac692dc9f2 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.581938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d79c-c863-4f99-9950-33ac692dc9f2 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.586936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64054f-4c85-4e45-8fd0-a58b52fef74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.587541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64054f-4c85-4e45-8fd0-a58b52fef74a admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.587849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64054f-4c85-4e45-8fd0-a58b52fef74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.588899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64054f-4c85-4e45-8fd0-a58b52fef74a admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.589770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64054f-4c85-4e45-8fd0-a58b52fef74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:42.590151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64054f-4c85-4e45-8fd0-a58b52fef74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.591766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64054f-4c85-4e45-8fd0-a58b52fef74a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.603975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1302/2575] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:24:42.608170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64054f-4c85-4e45-8fd0-a58b52fef74a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.617922 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64054f-4c85-4e45-8fd0-a58b52fef74a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.622995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893a74a-9adb-46e8-b337-2cab3051562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.623893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893a74a-9adb-46e8-b337-2cab3051562d admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.624241 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893a74a-9adb-46e8-b337-2cab3051562d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.624462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893a74a-9adb-46e8-b337-2cab3051562d admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.625963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893a74a-9adb-46e8-b337-2cab3051562d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.627353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893a74a-9adb-46e8-b337-2cab3051562d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.636900 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1274/2576] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:42 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:42.641506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd7a74-0be9-4119-bf36-dbab0257a075 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.711300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd7a74-0be9-4119-bf36-dbab0257a075 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.716595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0458b-370f-4364-9c8c-08dcec360608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.717199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0458b-370f-4364-9c8c-08dcec360608 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.717478 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0458b-370f-4364-9c8c-08dcec360608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.717751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0458b-370f-4364-9c8c-08dcec360608 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.718374 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0458b-370f-4364-9c8c-08dcec360608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.720329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0458b-370f-4364-9c8c-08dcec360608 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.736325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1303/2577] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:42 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:42.740568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893a74a-9adb-46e8-b337-2cab3051562d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.800393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893a74a-9adb-46e8-b337-2cab3051562d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.804903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e57103-9762-4957-9ee9-8e168460cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.805501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57103-9762-4957-9ee9-8e168460cb82 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.805777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57103-9762-4957-9ee9-8e168460cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.806048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57103-9762-4957-9ee9-8e168460cb82 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.806699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e57103-9762-4957-9ee9-8e168460cb82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.808775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e57103-9762-4957-9ee9-8e168460cb82 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.844046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1275/2578] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:42 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:42.848207 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0458b-370f-4364-9c8c-08dcec360608 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.858020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0458b-370f-4364-9c8c-08dcec360608 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.862670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848531b-d795-473c-87fa-113200161166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.863274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848531b-d795-473c-87fa-113200161166 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.863555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848531b-d795-473c-87fa-113200161166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.863863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848531b-d795-473c-87fa-113200161166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.864504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848531b-d795-473c-87fa-113200161166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.866250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848531b-d795-473c-87fa-113200161166 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.877021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1276/2579] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:42.881735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848531b-d795-473c-87fa-113200161166 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.892162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848531b-d795-473c-87fa-113200161166 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.897433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de00b6c-4d3a-422f-a3af-64bb791ffaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.898126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de00b6c-4d3a-422f-a3af-64bb791ffaad admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.898506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de00b6c-4d3a-422f-a3af-64bb791ffaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.898787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de00b6c-4d3a-422f-a3af-64bb791ffaad admin admin] PATH_INFO: `/v3/projects/a00352cb20354f119ab181f1f93fc959/users/34a973b906374c7488e3a6141093d602/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.901017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1304/2580] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:42 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:42.910722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e57103-9762-4957-9ee9-8e168460cb82 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.915720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de00b6c-4d3a-422f-a3af-64bb791ffaad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00352cb20354f119ab181f1f93fc959, user_id=34a973b906374c7488e3a6141093d602, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.918500 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de00b6c-4d3a-422f-a3af-64bb791ffaad admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.920855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e57103-9762-4957-9ee9-8e168460cb82 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.926314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e88b0b-cd50-4602-b5c7-b36595dd9632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.926948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e88b0b-cd50-4602-b5c7-b36595dd9632 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.927213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e88b0b-cd50-4602-b5c7-b36595dd9632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.927489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e88b0b-cd50-4602-b5c7-b36595dd9632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.928164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e88b0b-cd50-4602-b5c7-b36595dd9632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.929739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e88b0b-cd50-4602-b5c7-b36595dd9632 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.941288 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1305/2581] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:42.945303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e88b0b-cd50-4602-b5c7-b36595dd9632 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.958507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e88b0b-cd50-4602-b5c7-b36595dd9632 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:42.963469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd15cfb-751e-426a-9f98-eee69f3b5d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:42.964127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd15cfb-751e-426a-9f98-eee69f3b5d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:42.964413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd15cfb-751e-426a-9f98-eee69f3b5d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:42.964689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd15cfb-751e-426a-9f98-eee69f3b5d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:42.965332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd15cfb-751e-426a-9f98-eee69f3b5d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:42.967021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd15cfb-751e-426a-9f98-eee69f3b5d6c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:42.977960 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1306/2582] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:42.982324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd15cfb-751e-426a-9f98-eee69f3b5d6c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:42.992215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd15cfb-751e-426a-9f98-eee69f3b5d6c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:43.000257 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1277/2583] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:42 2022] PUT /identity/v3/projects/a00352cb20354f119ab181f1f93fc959/users/34a973b906374c7488e3a6141093d602/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:43.004096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de00b6c-4d3a-422f-a3af-64bb791ffaad admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:43.065966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0711b0-23f7-47a5-af7d-975f802b9fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:43.067267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0711b0-23f7-47a5-af7d-975f802b9fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:43.067558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0711b0-23f7-47a5-af7d-975f802b9fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:43.068008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0711b0-23f7-47a5-af7d-975f802b9fd3 admin admin] PATH_INFO: `/v3/projects/6bf1afed30674e6784be276413fcfdf7/users/3643ad79b6d54a2c8f75cd085be6aead/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:43.086810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0711b0-23f7-47a5-af7d-975f802b9fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf1afed30674e6784be276413fcfdf7, user_id=3643ad79b6d54a2c8f75cd085be6aead, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:43.090975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0711b0-23f7-47a5-af7d-975f802b9fd3 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:43.095583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:43.152423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de00b6c-4d3a-422f-a3af-64bb791ffaad admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:43.175087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1307/2584] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:42 2022] PUT /identity/v3/projects/6bf1afed30674e6784be276413fcfdf7/users/3643ad79b6d54a2c8f75cd085be6aead/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:43.177209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18b39-f48b-4f00-8fc7-5122402fad65 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:43.177791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18b39-f48b-4f00-8fc7-5122402fad65 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:43.178212 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18b39-f48b-4f00-8fc7-5122402fad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:43.214023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-67f18b39-f48b-4f00-8fc7-5122402fad65 None None] MFA Rules not processed for user `3643ad79b6d54a2c8f75cd085be6aead`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:43.219240 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-67f18b39-f48b-4f00-8fc7-5122402fad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:43.232217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99854008-95dc-4f65-a15a-a977109828f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:43.232836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99854008-95dc-4f65-a15a-a977109828f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:43.233113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99854008-95dc-4f65-a15a-a977109828f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:43.233393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99854008-95dc-4f65-a15a-a977109828f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:43.234027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99854008-95dc-4f65-a15a-a977109828f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:43.235641 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99854008-95dc-4f65-a15a-a977109828f2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:43.247856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1278/2585] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:43.251286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99854008-95dc-4f65-a15a-a977109828f2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:43.262405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99854008-95dc-4f65-a15a-a977109828f2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:43.267956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca73a7f-937b-4672-aa20-435f504b47a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:43.272343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca73a7f-937b-4672-aa20-435f504b47a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:43.275438 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca73a7f-937b-4672-aa20-435f504b47a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:43.281085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca73a7f-937b-4672-aa20-435f504b47a9 admin admin] PATH_INFO: `/v3/projects/a00352cb20354f119ab181f1f93fc959/users/34a973b906374c7488e3a6141093d602/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:43.285072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca73a7f-937b-4672-aa20-435f504b47a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00352cb20354f119ab181f1f93fc959, user_id=34a973b906374c7488e3a6141093d602, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:43.288312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca73a7f-937b-4672-aa20-435f504b47a9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:43.297749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1308/2586] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:43.304354 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1279/2587] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:43 2022] PUT /identity/v3/projects/a00352cb20354f119ab181f1f93fc959/users/34a973b906374c7488e3a6141093d602/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:43.310927 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18b39-f48b-4f00-8fc7-5122402fad65 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:43.312937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-67f18b39-f48b-4f00-8fc7-5122402fad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:43.320375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85bfd5-0981-4a94-b41a-4394fc898504 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:43.320673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85bfd5-0981-4a94-b41a-4394fc898504 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:43.320947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85bfd5-0981-4a94-b41a-4394fc898504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:43.363014 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ca85bfd5-0981-4a94-b41a-4394fc898504 None None] MFA Rules not processed for user `34a973b906374c7488e3a6141093d602`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:43.364491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ca85bfd5-0981-4a94-b41a-4394fc898504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:43.400773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18b39-f48b-4f00-8fc7-5122402fad65 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:43.454657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:43.457002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d307b-6593-456b-938d-535264517ae7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'decb5421872c4034bbbaa8c3cd9dcb5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:43.457626 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d307b-6593-456b-938d-535264517ae7 service glance] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:43.457906 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d307b-6593-456b-938d-535264517ae7 service glance] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:43.458180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d307b-6593-456b-938d-535264517ae7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:43.484192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1280/2588] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:43.495718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85bfd5-0981-4a94-b41a-4394fc898504 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:43.497254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ca85bfd5-0981-4a94-b41a-4394fc898504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:43.524653 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d307b-6593-456b-938d-535264517ae7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:43.526858 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d307b-6593-456b-938d-535264517ae7 service glance] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:43.538834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1309/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:43.569634 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85bfd5-0981-4a94-b41a-4394fc898504 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:43.575665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bec74e-65c9-4230-9521-58bf8df5ab3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:43.576315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bec74e-65c9-4230-9521-58bf8df5ab3e service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:43.576600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bec74e-65c9-4230-9521-58bf8df5ab3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:43.576950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bec74e-65c9-4230-9521-58bf8df5ab3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:43.592692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bec74e-65c9-4230-9521-58bf8df5ab3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:43.594483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bec74e-65c9-4230-9521-58bf8df5ab3e service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:43.606847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1281/2590] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:24:43.935702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:43.989375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d307b-6593-456b-938d-535264517ae7 service glance] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:43.998710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d307b-6593-456b-938d-535264517ae7 service glance] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:44.002371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a322dd-005b-40c2-916b-a927d344ac3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:44.002976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a322dd-005b-40c2-916b-a927d344ac3f service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:44.003433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a322dd-005b-40c2-916b-a927d344ac3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:44.003925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a322dd-005b-40c2-916b-a927d344ac3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:44.073487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a322dd-005b-40c2-916b-a927d344ac3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:44.075033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a322dd-005b-40c2-916b-a927d344ac3f service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:44.087017 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1310/2591] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:44.125939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:44.894241 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45218f-74a3-479a-b760-5e35d860e7c3 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:44.894805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45218f-74a3-479a-b760-5e35d860e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:44.894805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45218f-74a3-479a-b760-5e35d860e7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:44.917101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-3f45218f-74a3-479a-b760-5e35d860e7c3 None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:44.918296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3f45218f-74a3-479a-b760-5e35d860e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:44.979506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1282/2592] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:44.992136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a322dd-005b-40c2-916b-a927d344ac3f service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:44.994257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-43a322dd-005b-40c2-916b-a927d344ac3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:45.033740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:45.069592 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a322dd-005b-40c2-916b-a927d344ac3f service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:45.074978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1e41e-63aa-47d2-934a-69907b673134 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:45.075654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e41e-63aa-47d2-934a-69907b673134 service swift] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:45.075925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e41e-63aa-47d2-934a-69907b673134 service swift] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:45.076206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e41e-63aa-47d2-934a-69907b673134 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:45.085243 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1e41e-63aa-47d2-934a-69907b673134 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:45.086915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1e41e-63aa-47d2-934a-69907b673134 service swift] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:45.096031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1311/2593] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:24:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:24:45.562549 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45218f-74a3-479a-b760-5e35d860e7c3 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:45.564144 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3f45218f-74a3-479a-b760-5e35d860e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:45.699913 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45218f-74a3-479a-b760-5e35d860e7c3 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:45.721413 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:45.722083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:45.722355 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:45.722624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] PATH_INFO: `/v3/users/cbe2ea7610724cfabc1695c9ab429ae7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:45.723896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe2ea7610724cfabc1695c9ab429ae7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:45.725884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:45.989758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe2ea7610724cfabc1695c9ab429ae7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:46.049661 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe2ea7610724cfabc1695c9ab429ae7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:46.070326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe2ea7610724cfabc1695c9ab429ae7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:46.071345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe2ea7610724cfabc1695c9ab429ae7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:46.079926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe2ea7610724cfabc1695c9ab429ae7'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:46.086948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1283/2594] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:45 2022] DELETE /identity/v3/users/cbe2ea7610724cfabc1695c9ab429ae7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:46.092113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bc26b-129d-4b2d-9445-71b74188f090 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:46.093151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bc26b-129d-4b2d-9445-71b74188f090 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:46.093583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bc26b-129d-4b2d-9445-71b74188f090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:46.126272 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ca0bc26b-129d-4b2d-9445-71b74188f090 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:46.128088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ca0bc26b-129d-4b2d-9445-71b74188f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:46.208245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1312/2595] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:46.218475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:46.220228 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:46.232680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:46.301348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb624e5-22ba-44c4-836c-66304be385fa admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:46.314288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01653f-963c-41a5-9ce6-5c80e688f06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:46.314939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01653f-963c-41a5-9ce6-5c80e688f06b service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:46.315218 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01653f-963c-41a5-9ce6-5c80e688f06b service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:46.315491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01653f-963c-41a5-9ce6-5c80e688f06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:46.330971 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01653f-963c-41a5-9ce6-5c80e688f06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:46.333144 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01653f-963c-41a5-9ce6-5c80e688f06b service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:46.347452 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1284/2596] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:46.952387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bc26b-129d-4b2d-9445-71b74188f090 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:46.954030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ca0bc26b-129d-4b2d-9445-71b74188f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:46.977658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bc26b-129d-4b2d-9445-71b74188f090 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:46.983829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:46.984771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:46.985213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:46.985648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] PATH_INFO: `/v3/projects/e359470187194dd29c80cf66e9eeeb55` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:46.987463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e359470187194dd29c80cf66e9eeeb55)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:46.998480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:47.141848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e359470187194dd29c80cf66e9eeeb55', 'request_id': 'req-f8df6fe7-5ad3-4662-827f-f003e7069f9e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.220327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e359470187194dd29c80cf66e9eeeb55', 'request_id': 'req-f8df6fe7-5ad3-4662-827f-f003e7069f9e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.229619 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e359470187194dd29c80cf66e9eeeb55', 'request_id': 'req-f8df6fe7-5ad3-4662-827f-f003e7069f9e'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.252801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] The token cache is being invalidate because project e359470187194dd29c80cf66e9eeeb55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:47.253176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.253992 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.256205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1313/2597] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:46 2022] DELETE /identity/v3/projects/e359470187194dd29c80cf66e9eeeb55 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:47.260018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01653f-963c-41a5-9ce6-5c80e688f06b service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:47.273043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01653f-963c-41a5-9ce6-5c80e688f06b service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:47.347417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:47.348105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:47.348397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:47.348674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] PATH_INFO: `/v3/users/e027b4ec1f3a419286eac5c453c6a0e4` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:47.349909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e027b4ec1f3a419286eac5c453c6a0e4)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:47.352010 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:47.527318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e027b4ec1f3a419286eac5c453c6a0e4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.622506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e027b4ec1f3a419286eac5c453c6a0e4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.643783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e027b4ec1f3a419286eac5c453c6a0e4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.644590 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e027b4ec1f3a419286eac5c453c6a0e4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.653768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e027b4ec1f3a419286eac5c453c6a0e4'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:47.661242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1285/2598] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:47 2022] DELETE /identity/v3/users/e027b4ec1f3a419286eac5c453c6a0e4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:48.208346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:48.213756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:48.227493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df6fe7-5ad3-4662-827f-f003e7069f9e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:48.295245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:48.317516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:48.318192 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:48.318570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:48.318941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] PATH_INFO: `/v3/projects/beef24574bf54d8e8a9e63343efc0cba` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:48.320464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beef24574bf54d8e8a9e63343efc0cba)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:48.322595 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:48.508158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beef24574bf54d8e8a9e63343efc0cba', 'request_id': 'req-5aacbc83-0f75-483f-a2ff-7e8455b06715'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:48.581247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beef24574bf54d8e8a9e63343efc0cba', 'request_id': 'req-5aacbc83-0f75-483f-a2ff-7e8455b06715'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:48.593640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beef24574bf54d8e8a9e63343efc0cba', 'request_id': 'req-5aacbc83-0f75-483f-a2ff-7e8455b06715'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:48.608120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] The token cache is being invalidate because project beef24574bf54d8e8a9e63343efc0cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:48.608489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:48.609157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:48.610691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1314/2599] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:48 2022] DELETE /identity/v3/projects/beef24574bf54d8e8a9e63343efc0cba => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:48.615224 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:48.616970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:48.634467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7920c-a903-495c-9aff-b9b8fec9fd00 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:48.689310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:48.726017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:48.726777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:48.727090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:48.727495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] PATH_INFO: `/v3/users/6911465392ce46acb2a7de2778c88e76` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:48.729011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6911465392ce46acb2a7de2778c88e76)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:48.730934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:48.928340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6911465392ce46acb2a7de2778c88e76'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.014318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6911465392ce46acb2a7de2778c88e76'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.031511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6911465392ce46acb2a7de2778c88e76'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.032602 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6911465392ce46acb2a7de2778c88e76'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.044891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f5d1a7fa-66c6-4848-b7f6-8a4fa29a6ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6911465392ce46acb2a7de2778c88e76'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.053350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1286/2600] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:48 2022] DELETE /identity/v3/users/6911465392ce46acb2a7de2778c88e76 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:49.548756 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:49.551055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:49.595437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacbc83-0f75-483f-a2ff-7e8455b06715 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:49.702971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:49.704070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:49.704754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:49.705279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] PATH_INFO: `/v3/projects/8023f82bfb8145acbe4d431fd332459b` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:49.707701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8023f82bfb8145acbe4d431fd332459b)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:49.710043 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:49.825829 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8023f82bfb8145acbe4d431fd332459b', 'request_id': 'req-633f6d93-09e8-4d31-b1c1-4f98e348d419'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.912204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8023f82bfb8145acbe4d431fd332459b', 'request_id': 'req-633f6d93-09e8-4d31-b1c1-4f98e348d419'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.924806 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8023f82bfb8145acbe4d431fd332459b', 'request_id': 'req-633f6d93-09e8-4d31-b1c1-4f98e348d419'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.946900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] The token cache is being invalidate because project 8023f82bfb8145acbe4d431fd332459b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:49.947195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.948755 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-633f6d93-09e8-4d31-b1c1-4f98e348d419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:49.950671 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1315/2601] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:49 2022] DELETE /identity/v3/projects/8023f82bfb8145acbe4d431fd332459b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:49.956261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8c4af-0df4-45e6-9b3e-88e7c59d19b6 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:49.957107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8c4af-0df4-45e6-9b3e-88e7c59d19b6 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:49.957542 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8c4af-0df4-45e6-9b3e-88e7c59d19b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:49.979798 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-3cf8c4af-0df4-45e6-9b3e-88e7c59d19b6 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:49.981333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3cf8c4af-0df4-45e6-9b3e-88e7c59d19b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:50.081168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1287/2602] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:50.089434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121a1d0-6fb7-425f-9834-f330177f8016 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:50.089726 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121a1d0-6fb7-425f-9834-f330177f8016 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:50.090004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121a1d0-6fb7-425f-9834-f330177f8016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:50.106999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:50.113303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-a121a1d0-6fb7-425f-9834-f330177f8016 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:50.114538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a121a1d0-6fb7-425f-9834-f330177f8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:50.131442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1316/2603] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:50.144685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8c4af-0df4-45e6-9b3e-88e7c59d19b6 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:50.153406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8c4af-0df4-45e6-9b3e-88e7c59d19b6 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:50.166941 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751633b3-a885-4599-b5b0-f4edd5fc6c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:50.168041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751633b3-a885-4599-b5b0-f4edd5fc6c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:50.172662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751633b3-a885-4599-b5b0-f4edd5fc6c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:50.172662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751633b3-a885-4599-b5b0-f4edd5fc6c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:50.172662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751633b3-a885-4599-b5b0-f4edd5fc6c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:50.172662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751633b3-a885-4599-b5b0-f4edd5fc6c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:50.172662 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751633b3-a885-4599-b5b0-f4edd5fc6c40 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:50.199435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1288/2604] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:24:50.210851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121a1d0-6fb7-425f-9834-f330177f8016 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:50.223009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121a1d0-6fb7-425f-9834-f330177f8016 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:50.228731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4861c1-a117-4190-8f48-9082d2555530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:50.229329 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4861c1-a117-4190-8f48-9082d2555530 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:50.230352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4861c1-a117-4190-8f48-9082d2555530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:50.230352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4861c1-a117-4190-8f48-9082d2555530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:50.230659 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4861c1-a117-4190-8f48-9082d2555530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:50.232774 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4861c1-a117-4190-8f48-9082d2555530 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:50.363643 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1317/2605] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:50 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:50.368037 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751633b3-a885-4599-b5b0-f4edd5fc6c40 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:50.380105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751633b3-a885-4599-b5b0-f4edd5fc6c40 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:50.440229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:50.481643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c37f7-fb81-41e1-bc52-3f1e7dd93601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:50.481643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c37f7-fb81-41e1-bc52-3f1e7dd93601 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:50.481643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c37f7-fb81-41e1-bc52-3f1e7dd93601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:50.481643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c37f7-fb81-41e1-bc52-3f1e7dd93601 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:50.482336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c37f7-fb81-41e1-bc52-3f1e7dd93601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:50.482336 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c37f7-fb81-41e1-bc52-3f1e7dd93601 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:50.813852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1289/2606] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:50 2022] POST /identity/v3/users => generated 292 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:50.814021 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4861c1-a117-4190-8f48-9082d2555530 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:50.825552 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4861c1-a117-4190-8f48-9082d2555530 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:50.839719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08345dce-dc8b-43d2-9413-fa32e0ddace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:50.840429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08345dce-dc8b-43d2-9413-fa32e0ddace5 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:50.840834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08345dce-dc8b-43d2-9413-fa32e0ddace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:50.841663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08345dce-dc8b-43d2-9413-fa32e0ddace5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:50.842953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08345dce-dc8b-43d2-9413-fa32e0ddace5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:50.846684 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08345dce-dc8b-43d2-9413-fa32e0ddace5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:50.859275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1318/2607] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:50.863897 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c37f7-fb81-41e1-bc52-3f1e7dd93601 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:50.875041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c37f7-fb81-41e1-bc52-3f1e7dd93601 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:50.880673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cf036-b8e7-4a1e-b12f-13151328362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:50.886927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf036-b8e7-4a1e-b12f-13151328362d admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:50.886927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf036-b8e7-4a1e-b12f-13151328362d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:50.886927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf036-b8e7-4a1e-b12f-13151328362d admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:50.886927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cf036-b8e7-4a1e-b12f-13151328362d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:50.886927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cf036-b8e7-4a1e-b12f-13151328362d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:50.898769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1290/2608] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:50.901267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08345dce-dc8b-43d2-9413-fa32e0ddace5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:50.911991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08345dce-dc8b-43d2-9413-fa32e0ddace5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:50.928454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b621794-f98d-4d42-a601-cc3456c44428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:50.929404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b621794-f98d-4d42-a601-cc3456c44428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:50.929851 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b621794-f98d-4d42-a601-cc3456c44428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:50.930632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b621794-f98d-4d42-a601-cc3456c44428 admin admin] PATH_INFO: `/v3/projects/0d4083fa0dea4155a7c149850ab3d925/users/0cc9c27dac8c4d35ac61e3150255535e/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:50.958160 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b621794-f98d-4d42-a601-cc3456c44428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4083fa0dea4155a7c149850ab3d925, user_id=0cc9c27dac8c4d35ac61e3150255535e, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:50.961912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b621794-f98d-4d42-a601-cc3456c44428 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:51.083966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1319/2609] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:50 2022] PUT /identity/v3/projects/0d4083fa0dea4155a7c149850ab3d925/users/0cc9c27dac8c4d35ac61e3150255535e/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:51.167189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f8fe4-c1f8-4f50-b1e1-f18f3c22b4bf None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:51.168529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f8fe4-c1f8-4f50-b1e1-f18f3c22b4bf None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:51.168970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f8fe4-c1f8-4f50-b1e1-f18f3c22b4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:51.207880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-166f8fe4-c1f8-4f50-b1e1-f18f3c22b4bf None None] MFA Rules not processed for user `0cc9c27dac8c4d35ac61e3150255535e`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:51.209408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-166f8fe4-c1f8-4f50-b1e1-f18f3c22b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:51.303174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1291/2610] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:51.315752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b621794-f98d-4d42-a601-cc3456c44428 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:51.320699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5b621794-f98d-4d42-a601-cc3456c44428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:51.387987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b621794-f98d-4d42-a601-cc3456c44428 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:51.391840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c487bca-4f7c-4d84-b230-c27c6c628da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:51.392483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c487bca-4f7c-4d84-b230-c27c6c628da9 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:51.392834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c487bca-4f7c-4d84-b230-c27c6c628da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:51.393122 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c487bca-4f7c-4d84-b230-c27c6c628da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:51.414137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c487bca-4f7c-4d84-b230-c27c6c628da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:51.415607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c487bca-4f7c-4d84-b230-c27c6c628da9 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:51.444393 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1320/2611] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:54.787069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f8fe4-c1f8-4f50-b1e1-f18f3c22b4bf None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:54.855774 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f8fe4-c1f8-4f50-b1e1-f18f3c22b4bf None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:54.860506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:54.863735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:54.863735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:54.863735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] PATH_INFO: `/v3/users/0cc9c27dac8c4d35ac61e3150255535e` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:54.863735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc9c27dac8c4d35ac61e3150255535e)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:54.864926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:55.104829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc9c27dac8c4d35ac61e3150255535e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.107016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:55.170302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc9c27dac8c4d35ac61e3150255535e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.190587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc9c27dac8c4d35ac61e3150255535e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.194873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc9c27dac8c4d35ac61e3150255535e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.195132 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c487bca-4f7c-4d84-b230-c27c6c628da9 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:55.196023 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4c487bca-4f7c-4d84-b230-c27c6c628da9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:55.200974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-befccae2-a9ab-49a1-975b-949e3ec44c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc9c27dac8c4d35ac61e3150255535e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.208440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1292/2612] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:54 2022] DELETE /identity/v3/users/0cc9c27dac8c4d35ac61e3150255535e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:55.210864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c487bca-4f7c-4d84-b230-c27c6c628da9 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:55.212694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228349-7cdb-452e-99a4-0c00395f5c0d None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:55.212981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228349-7cdb-452e-99a4-0c00395f5c0d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:55.213248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228349-7cdb-452e-99a4-0c00395f5c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:55.232582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-88228349-7cdb-452e-99a4-0c00395f5c0d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:55.234654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-88228349-7cdb-452e-99a4-0c00395f5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:55.285934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:55.286859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:55.287234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:55.287572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] PATH_INFO: `/v3/users/12b115c5155947dea3ea7bf7dc15dd72` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:55.289609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b115c5155947dea3ea7bf7dc15dd72)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:55.292538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:55.321054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1293/2613] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:55.331917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88228349-7cdb-452e-99a4-0c00395f5c0d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:55.333433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-88228349-7cdb-452e-99a4-0c00395f5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:55.393158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88228349-7cdb-452e-99a4-0c00395f5c0d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:55.396725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c889-0c81-423a-8f6b-208d6d41bcfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:55.397334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c889-0c81-423a-8f6b-208d6d41bcfd service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:55.397612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c889-0c81-423a-8f6b-208d6d41bcfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:55.397884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c889-0c81-423a-8f6b-208d6d41bcfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:55.407048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c889-0c81-423a-8f6b-208d6d41bcfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:55.408581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c889-0c81-423a-8f6b-208d6d41bcfd service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:55.419473 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1294/2614] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:24:55.516848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b115c5155947dea3ea7bf7dc15dd72'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.517526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b115c5155947dea3ea7bf7dc15dd72'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.519398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:55.621572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b115c5155947dea3ea7bf7dc15dd72'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.622215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b115c5155947dea3ea7bf7dc15dd72'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.629644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b115c5155947dea3ea7bf7dc15dd72'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:55.651913 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1321/2615] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:55 2022] DELETE /identity/v3/users/12b115c5155947dea3ea7bf7dc15dd72 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:55.659020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e66f87-9cb8-4d4e-8bae-a7f4ce2dfaea None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:55.659020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e66f87-9cb8-4d4e-8bae-a7f4ce2dfaea None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:55.659020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e66f87-9cb8-4d4e-8bae-a7f4ce2dfaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:55.680329 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-56e66f87-9cb8-4d4e-8bae-a7f4ce2dfaea None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:55.681844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-56e66f87-9cb8-4d4e-8bae-a7f4ce2dfaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:55.750187 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1295/2616] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:55.760362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:55.762984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:55.824396 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b97a13-8fd6-4ecd-86e9-f3a9373e9bbc admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:55.828217 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acba70-956f-421b-aef5-5db7c789d2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:55.828830 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acba70-956f-421b-aef5-5db7c789d2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:55.829114 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acba70-956f-421b-aef5-5db7c789d2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:55.829390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acba70-956f-421b-aef5-5db7c789d2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:55.839602 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acba70-956f-421b-aef5-5db7c789d2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:55.841035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acba70-956f-421b-aef5-5db7c789d2c5 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:55.850609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1322/2617] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:55.907808 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e66f87-9cb8-4d4e-8bae-a7f4ce2dfaea None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:55.909672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-56e66f87-9cb8-4d4e-8bae-a7f4ce2dfaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:55.923248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e66f87-9cb8-4d4e-8bae-a7f4ce2dfaea None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:55.929126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:55.929439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:55.929698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:55.929977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] PATH_INFO: `/v3/projects/0d4083fa0dea4155a7c149850ab3d925` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:55.931439 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4083fa0dea4155a7c149850ab3d925)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:55.934220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:55.937592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:56.067683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4083fa0dea4155a7c149850ab3d925', 'request_id': 'req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.074686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4083fa0dea4155a7c149850ab3d925', 'request_id': 'req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.169486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4083fa0dea4155a7c149850ab3d925', 'request_id': 'req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.182172 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] The token cache is being invalidate because project 0d4083fa0dea4155a7c149850ab3d925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:56.182470 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.183145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b7f10786-6e4a-4e23-ae3d-c46b1ad3a223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.185381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1296/2618] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:55 2022] DELETE /identity/v3/projects/0d4083fa0dea4155a7c149850ab3d925 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:56.190031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a449674-f921-4505-afeb-f35e756a43d1 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.190325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a449674-f921-4505-afeb-f35e756a43d1 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.190648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a449674-f921-4505-afeb-f35e756a43d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.211068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8a449674-f921-4505-afeb-f35e756a43d1 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:56.212481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8a449674-f921-4505-afeb-f35e756a43d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:56.271687 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1323/2619] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:56.280081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b57ad-871f-4baa-9d84-757b4b09438c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.280370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b57ad-871f-4baa-9d84-757b4b09438c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.280651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b57ad-871f-4baa-9d84-757b4b09438c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.302450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-991b57ad-871f-4baa-9d84-757b4b09438c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:56.303772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-991b57ad-871f-4baa-9d84-757b4b09438c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:56.305102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a449674-f921-4505-afeb-f35e756a43d1 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:56.306855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8a449674-f921-4505-afeb-f35e756a43d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:56.312973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1297/2620] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:56.318364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b57ad-871f-4baa-9d84-757b4b09438c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:56.320320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a449674-f921-4505-afeb-f35e756a43d1 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:56.326535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:56.327252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.327536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.327861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] PATH_INFO: `/v3/projects/29504c15aecb4f0fa4c0b35ea661682b` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.329071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=29504c15aecb4f0fa4c0b35ea661682b)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:56.329454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b57ad-871f-4baa-9d84-757b4b09438c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:56.331236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:56.336928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1157df-eba0-4d9c-bf3c-85ee70f686c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:56.337836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1157df-eba0-4d9c-bf3c-85ee70f686c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.339170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1157df-eba0-4d9c-bf3c-85ee70f686c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.339170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1157df-eba0-4d9c-bf3c-85ee70f686c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.339855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1157df-eba0-4d9c-bf3c-85ee70f686c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:56.340169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1157df-eba0-4d9c-bf3c-85ee70f686c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:56.341855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1157df-eba0-4d9c-bf3c-85ee70f686c9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:56.360146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1298/2621] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:24:56.361724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1157df-eba0-4d9c-bf3c-85ee70f686c9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:56.374129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1157df-eba0-4d9c-bf3c-85ee70f686c9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:56.379185 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ebd0c-111b-4f3e-8178-dfabcf0793f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:56.379825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ebd0c-111b-4f3e-8178-dfabcf0793f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.380110 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ebd0c-111b-4f3e-8178-dfabcf0793f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.380390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ebd0c-111b-4f3e-8178-dfabcf0793f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.381020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ebd0c-111b-4f3e-8178-dfabcf0793f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:56.383015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ebd0c-111b-4f3e-8178-dfabcf0793f2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:56.465166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29504c15aecb4f0fa4c0b35ea661682b', 'request_id': 'req-ad4396d4-8ddb-410a-b45b-34a660aaf20c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.481025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1299/2622] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:56 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:56.485299 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ebd0c-111b-4f3e-8178-dfabcf0793f2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:56.529576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29504c15aecb4f0fa4c0b35ea661682b', 'request_id': 'req-ad4396d4-8ddb-410a-b45b-34a660aaf20c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.536588 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29504c15aecb4f0fa4c0b35ea661682b', 'request_id': 'req-ad4396d4-8ddb-410a-b45b-34a660aaf20c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.540504 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:56.547555 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] The token cache is being invalidate because project 29504c15aecb4f0fa4c0b35ea661682b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:56.547896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.548565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.550234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1324/2623] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:56 2022] DELETE /identity/v3/projects/29504c15aecb4f0fa4c0b35ea661682b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:56.551578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ebd0c-111b-4f3e-8178-dfabcf0793f2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:56.554315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:56.555650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:56.556553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fec6b-fcf3-4b9a-820a-d11d0adcfe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:56.557698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fec6b-fcf3-4b9a-820a-d11d0adcfe82 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.557970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fec6b-fcf3-4b9a-820a-d11d0adcfe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.558243 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fec6b-fcf3-4b9a-820a-d11d0adcfe82 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.558896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fec6b-fcf3-4b9a-820a-d11d0adcfe82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:56.561106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fec6b-fcf3-4b9a-820a-d11d0adcfe82 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:56.622002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4396d4-8ddb-410a-b45b-34a660aaf20c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:56.626705 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:56.627338 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.627640 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.627925 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] PATH_INFO: `/v3/users/34a973b906374c7488e3a6141093d602` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.629060 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a973b906374c7488e3a6141093d602)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:56.631019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:56.644234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1300/2624] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:56 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:56.648405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fec6b-fcf3-4b9a-820a-d11d0adcfe82 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:56.650204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0c6fec6b-fcf3-4b9a-820a-d11d0adcfe82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:56.663101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fec6b-fcf3-4b9a-820a-d11d0adcfe82 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:56.667859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78a8f-8e15-40a2-845f-4aeafd30f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:56.671155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78a8f-8e15-40a2-845f-4aeafd30f593 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.671155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78a8f-8e15-40a2-845f-4aeafd30f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.671155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78a8f-8e15-40a2-845f-4aeafd30f593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.671155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78a8f-8e15-40a2-845f-4aeafd30f593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:56.671658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78a8f-8e15-40a2-845f-4aeafd30f593 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:56.681156 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1301/2625] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:56.685702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78a8f-8e15-40a2-845f-4aeafd30f593 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:56.695696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78a8f-8e15-40a2-845f-4aeafd30f593 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:56.701568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad7574-f54b-4f89-97f5-58b228f1e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:56.702176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad7574-f54b-4f89-97f5-58b228f1e6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.702461 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad7574-f54b-4f89-97f5-58b228f1e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.702737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad7574-f54b-4f89-97f5-58b228f1e6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.703380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad7574-f54b-4f89-97f5-58b228f1e6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:56.705238 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad7574-f54b-4f89-97f5-58b228f1e6e2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:56.721921 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1302/2626] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:24:56.723067 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad7574-f54b-4f89-97f5-58b228f1e6e2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:56.734846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad7574-f54b-4f89-97f5-58b228f1e6e2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:56.742222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790c1e0-ff13-408c-b0ed-0d9b74e2954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:56.745898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790c1e0-ff13-408c-b0ed-0d9b74e2954a admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.745898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790c1e0-ff13-408c-b0ed-0d9b74e2954a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.745898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790c1e0-ff13-408c-b0ed-0d9b74e2954a admin admin] PATH_INFO: `/v3/projects/923440081cdc45d58b408280170942c3/users/8c635a31617d406dab0c85da603f7dd5/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.764029 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790c1e0-ff13-408c-b0ed-0d9b74e2954a admin admin] RBAC: Authorizing `identity:create_grant(project_id=923440081cdc45d58b408280170942c3, user_id=8c635a31617d406dab0c85da603f7dd5, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:56.770136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790c1e0-ff13-408c-b0ed-0d9b74e2954a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:56.770136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:56.802844 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a973b906374c7488e3a6141093d602'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.803556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a973b906374c7488e3a6141093d602'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.844689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1303/2627] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:56 2022] PUT /identity/v3/projects/923440081cdc45d58b408280170942c3/users/8c635a31617d406dab0c85da603f7dd5/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:56.856904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709744d-bae0-40c1-bab8-ef9bb3537953 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:56.857190 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709744d-bae0-40c1-bab8-ef9bb3537953 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:56.857469 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709744d-bae0-40c1-bab8-ef9bb3537953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:56.890069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b709744d-bae0-40c1-bab8-ef9bb3537953 None None] MFA Rules not processed for user `8c635a31617d406dab0c85da603f7dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:56.891365 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b709744d-bae0-40c1-bab8-ef9bb3537953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:56.906435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a973b906374c7488e3a6141093d602'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.907140 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a973b906374c7488e3a6141093d602'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.914753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a973b906374c7488e3a6141093d602'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:56.933201 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1325/2628] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:24:56 2022] DELETE /identity/v3/users/34a973b906374c7488e3a6141093d602 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:56.958571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1304/2629] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:56.972888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:56.975521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:57.036123 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56170ab2-a3df-40f1-a36a-3966778d4ff6 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:57.039852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc085b2-53cf-4c33-8585-f23f51be99ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:57.040497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc085b2-53cf-4c33-8585-f23f51be99ec service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:57.040812 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc085b2-53cf-4c33-8585-f23f51be99ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:57.041089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc085b2-53cf-4c33-8585-f23f51be99ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:57.066930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:57.097460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc085b2-53cf-4c33-8585-f23f51be99ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:57.098897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc085b2-53cf-4c33-8585-f23f51be99ec service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:57.111013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1326/2630] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:24:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:24:57.377601 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709744d-bae0-40c1-bab8-ef9bb3537953 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:57.379132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b709744d-bae0-40c1-bab8-ef9bb3537953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:57.453643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709744d-bae0-40c1-bab8-ef9bb3537953 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:57.510912 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:57.511547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:57.511859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:57.512136 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] PATH_INFO: `/v3/projects/a00352cb20354f119ab181f1f93fc959` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:57.513283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00352cb20354f119ab181f1f93fc959)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:57.515170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:57.621521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:57.633614 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00352cb20354f119ab181f1f93fc959', 'request_id': 'req-4b83a2fc-16d1-466f-a373-5f51b97d6370'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:57.640323 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00352cb20354f119ab181f1f93fc959', 'request_id': 'req-4b83a2fc-16d1-466f-a373-5f51b97d6370'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:57.700025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00352cb20354f119ab181f1f93fc959', 'request_id': 'req-4b83a2fc-16d1-466f-a373-5f51b97d6370'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:57.711708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] The token cache is being invalidate because project a00352cb20354f119ab181f1f93fc959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:24:57.712001 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:57.712682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b83a2fc-16d1-466f-a373-5f51b97d6370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:24:57.714929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1305/2631] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:24:57 2022] DELETE /identity/v3/projects/a00352cb20354f119ab181f1f93fc959 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:57.719768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb456d4-1efb-41a0-9c66-21dc2a64ee1c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:57.720229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb456d4-1efb-41a0-9c66-21dc2a64ee1c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:57.720343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb456d4-1efb-41a0-9c66-21dc2a64ee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:57.740521 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ecb456d4-1efb-41a0-9c66-21dc2a64ee1c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:57.748668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ecb456d4-1efb-41a0-9c66-21dc2a64ee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:57.823082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1327/2632] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:57.830622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb47d2-da3a-4aa0-94ba-cb19732c7401 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:57.831175 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb47d2-da3a-4aa0-94ba-cb19732c7401 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:57.831454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb47d2-da3a-4aa0-94ba-cb19732c7401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:57.854866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-a2fb47d2-da3a-4aa0-94ba-cb19732c7401 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:57.857159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a2fb47d2-da3a-4aa0-94ba-cb19732c7401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:57.865902 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1306/2633] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:24:57.870901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb456d4-1efb-41a0-9c66-21dc2a64ee1c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:57.880908 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb456d4-1efb-41a0-9c66-21dc2a64ee1c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:57.885687 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f04982-9f61-4d0e-8262-06a8c1f66a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:57.886335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f04982-9f61-4d0e-8262-06a8c1f66a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:57.886618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f04982-9f61-4d0e-8262-06a8c1f66a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:57.886892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f04982-9f61-4d0e-8262-06a8c1f66a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:57.887562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f04982-9f61-4d0e-8262-06a8c1f66a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:24:57.887891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f04982-9f61-4d0e-8262-06a8c1f66a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:57.889562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f04982-9f61-4d0e-8262-06a8c1f66a36 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:57.906590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1328/2634] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:24:57.908248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb47d2-da3a-4aa0-94ba-cb19732c7401 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:57.920359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb47d2-da3a-4aa0-94ba-cb19732c7401 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:57.925219 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656fd0-af76-4aa7-9d45-e9cf300718a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:57.925866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656fd0-af76-4aa7-9d45-e9cf300718a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:57.926123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656fd0-af76-4aa7-9d45-e9cf300718a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:57.926588 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656fd0-af76-4aa7-9d45-e9cf300718a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:57.927262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17656fd0-af76-4aa7-9d45-e9cf300718a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:57.930247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17656fd0-af76-4aa7-9d45-e9cf300718a2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:58.044047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1307/2635] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:57 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:58.045101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f04982-9f61-4d0e-8262-06a8c1f66a36 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:58.055819 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f04982-9f61-4d0e-8262-06a8c1f66a36 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:58.123395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1abd5-0e6c-43d2-8250-7d2e3b663784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:58.124432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1abd5-0e6c-43d2-8250-7d2e3b663784 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:58.124916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1abd5-0e6c-43d2-8250-7d2e3b663784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:58.125380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1abd5-0e6c-43d2-8250-7d2e3b663784 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:58.126224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1abd5-0e6c-43d2-8250-7d2e3b663784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:58.128247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1abd5-0e6c-43d2-8250-7d2e3b663784 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:59.046116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1329/2636] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:58 2022] POST /identity/v3/users => generated 283 bytes in 1000 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:59.049985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656fd0-af76-4aa7-9d45-e9cf300718a2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:59.060884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656fd0-af76-4aa7-9d45-e9cf300718a2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:59.065293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68406f44-d57a-4da4-9945-4ae1e93b70e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:59.066114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68406f44-d57a-4da4-9945-4ae1e93b70e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:59.066301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68406f44-d57a-4da4-9945-4ae1e93b70e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:59.066578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68406f44-d57a-4da4-9945-4ae1e93b70e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:59.067217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68406f44-d57a-4da4-9945-4ae1e93b70e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:59.068847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68406f44-d57a-4da4-9945-4ae1e93b70e8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:59.079168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1308/2637] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:59.083779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1abd5-0e6c-43d2-8250-7d2e3b663784 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:59.094371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1abd5-0e6c-43d2-8250-7d2e3b663784 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:59.099418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253f3a4-9b9f-4180-b0e0-f9eb969f33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:59.100155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253f3a4-9b9f-4180-b0e0-f9eb969f33a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:59.100439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253f3a4-9b9f-4180-b0e0-f9eb969f33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:59.100847 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253f3a4-9b9f-4180-b0e0-f9eb969f33a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:59.101557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253f3a4-9b9f-4180-b0e0-f9eb969f33a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:59.103371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253f3a4-9b9f-4180-b0e0-f9eb969f33a4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:59.116517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1330/2638] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:59.121408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68406f44-d57a-4da4-9945-4ae1e93b70e8 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:59.137938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68406f44-d57a-4da4-9945-4ae1e93b70e8 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:59.142887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f1166-1078-4ae5-a805-ff1f77c5ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:59.143548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f1166-1078-4ae5-a805-ff1f77c5ed67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:59.143858 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f1166-1078-4ae5-a805-ff1f77c5ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:59.144163 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f1166-1078-4ae5-a805-ff1f77c5ed67 admin admin] PATH_INFO: `/v3/projects/a53c121f4cd842a6be2315489ea48f71/users/5c9806b79993439e995fa7094c4a699e/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:59.160597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f1166-1078-4ae5-a805-ff1f77c5ed67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53c121f4cd842a6be2315489ea48f71, user_id=5c9806b79993439e995fa7094c4a699e, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:59.163559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f1166-1078-4ae5-a805-ff1f77c5ed67 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:59.255352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1309/2639] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:59 2022] PUT /identity/v3/projects/a53c121f4cd842a6be2315489ea48f71/users/5c9806b79993439e995fa7094c4a699e/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:24:59.262137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae72a-830f-4e51-8aa7-ffee06e85f0a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:59.262426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae72a-830f-4e51-8aa7-ffee06e85f0a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:59.262697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae72a-830f-4e51-8aa7-ffee06e85f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:59.291891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-7c1ae72a-830f-4e51-8aa7-ffee06e85f0a None None] MFA Rules not processed for user `5c9806b79993439e995fa7094c4a699e`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:59.293101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7c1ae72a-830f-4e51-8aa7-ffee06e85f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:59.311484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:59.358375 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1331/2640] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:24:59.363160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f1166-1078-4ae5-a805-ff1f77c5ed67 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:59.425522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f1166-1078-4ae5-a805-ff1f77c5ed67 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:59.430511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f7cf-e65e-4861-8a42-8b7e6fff9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:59.431127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f7cf-e65e-4861-8a42-8b7e6fff9476 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:59.431418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f7cf-e65e-4861-8a42-8b7e6fff9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:59.431732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f7cf-e65e-4861-8a42-8b7e6fff9476 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:59.433583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f7cf-e65e-4861-8a42-8b7e6fff9476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:59.434767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f7cf-e65e-4861-8a42-8b7e6fff9476 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:59.541352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1310/2641] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:24:59 2022] POST /identity/v3/projects => generated 359 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:24:59.545347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ae72a-830f-4e51-8aa7-ffee06e85f0a None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:59.559068 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ae72a-830f-4e51-8aa7-ffee06e85f0a None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:59.624418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609142c2-2d9f-4878-a636-e89ae6ffa234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:59.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609142c2-2d9f-4878-a636-e89ae6ffa234 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:59.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609142c2-2d9f-4878-a636-e89ae6ffa234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:59.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609142c2-2d9f-4878-a636-e89ae6ffa234 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:59.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609142c2-2d9f-4878-a636-e89ae6ffa234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:59.631011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609142c2-2d9f-4878-a636-e89ae6ffa234 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:59.743870 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1332/2642] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:24:59 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:24:59.746468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f7cf-e65e-4861-8a42-8b7e6fff9476 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:59.756879 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f7cf-e65e-4861-8a42-8b7e6fff9476 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:59.762383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9150009-a73d-43d8-931b-25e3fdb56de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:59.765936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150009-a73d-43d8-931b-25e3fdb56de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:59.766293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150009-a73d-43d8-931b-25e3fdb56de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:59.766630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150009-a73d-43d8-931b-25e3fdb56de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:59.767693 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9150009-a73d-43d8-931b-25e3fdb56de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:59.769162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9150009-a73d-43d8-931b-25e3fdb56de0 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:59.783104 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1311/2643] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:24:59.787685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609142c2-2d9f-4878-a636-e89ae6ffa234 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:59.800345 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609142c2-2d9f-4878-a636-e89ae6ffa234 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:24:59.805699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536fdf9-9e6b-4a88-8d27-32b8a43e5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:24:59.806644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536fdf9-9e6b-4a88-8d27-32b8a43e5901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:59.807518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536fdf9-9e6b-4a88-8d27-32b8a43e5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:59.807982 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536fdf9-9e6b-4a88-8d27-32b8a43e5901 admin admin] PATH_INFO: `/v3/projects/d171b51009574164b9fbc2a5d7958010/users/7db8285f1b394bb1aa299590e4edaa52/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:59.825786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536fdf9-9e6b-4a88-8d27-32b8a43e5901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d171b51009574164b9fbc2a5d7958010, user_id=7db8285f1b394bb1aa299590e4edaa52, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:24:59.828523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536fdf9-9e6b-4a88-8d27-32b8a43e5901 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:24:59.923305 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adeb23-f51d-4096-be28-1c248422ecd3 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:24:59.923608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adeb23-f51d-4096-be28-1c248422ecd3 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:24:59.923898 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adeb23-f51d-4096-be28-1c248422ecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:24:59.948460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-70adeb23-f51d-4096-be28-1c248422ecd3 None None] MFA Rules not processed for user `8c635a31617d406dab0c85da603f7dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:24:59.948460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-70adeb23-f51d-4096-be28-1c248422ecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:24:59.948670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1333/2644] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:24:59 2022] PUT /identity/v3/projects/d171b51009574164b9fbc2a5d7958010/users/7db8285f1b394bb1aa299590e4edaa52/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:24:59.952707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536fdf9-9e6b-4a88-8d27-32b8a43e5901 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:24:59.977509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:00.011731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1312/2645] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:00.034352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536fdf9-9e6b-4a88-8d27-32b8a43e5901 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:00.039120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c137e-6642-42a4-980d-aa65816a476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:00.039889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c137e-6642-42a4-980d-aa65816a476d admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:00.040174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c137e-6642-42a4-980d-aa65816a476d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:00.040448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c137e-6642-42a4-980d-aa65816a476d admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:00.041094 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c137e-6642-42a4-980d-aa65816a476d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:00.042828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c137e-6642-42a4-980d-aa65816a476d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:00.054040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1334/2646] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:00.058643 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adeb23-f51d-4096-be28-1c248422ecd3 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:00.070446 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adeb23-f51d-4096-be28-1c248422ecd3 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:00.076191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2745b-c69b-4de6-b997-efab502bc281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:00.076857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2745b-c69b-4de6-b997-efab502bc281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:00.077146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2745b-c69b-4de6-b997-efab502bc281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:00.077459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2745b-c69b-4de6-b997-efab502bc281 admin admin] PATH_INFO: `/v3/projects/d171b51009574164b9fbc2a5d7958010/users/7db8285f1b394bb1aa299590e4edaa52/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:00.079406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2745b-c69b-4de6-b997-efab502bc281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d171b51009574164b9fbc2a5d7958010, user_id=7db8285f1b394bb1aa299590e4edaa52, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:00.082466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2745b-c69b-4de6-b997-efab502bc281 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:00.094130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1313/2647] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:00 2022] PUT /identity/v3/projects/d171b51009574164b9fbc2a5d7958010/users/7db8285f1b394bb1aa299590e4edaa52/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:00.105326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bffc26-02f7-42dc-8523-21aa21a9a805 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:00.105615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bffc26-02f7-42dc-8523-21aa21a9a805 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:00.110957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bffc26-02f7-42dc-8523-21aa21a9a805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:00.149235 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-44bffc26-02f7-42dc-8523-21aa21a9a805 None None] MFA Rules not processed for user `7db8285f1b394bb1aa299590e4edaa52`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:00.150577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-44bffc26-02f7-42dc-8523-21aa21a9a805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:00.160895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:00.224287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1335/2648] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:00.240346 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2745b-c69b-4de6-b997-efab502bc281 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:00.242212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-62c2745b-c69b-4de6-b997-efab502bc281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:00.310790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2745b-c69b-4de6-b997-efab502bc281 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:00.314833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092786-4233-4f2a-8ea5-a3e459c231c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:00.315482 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092786-4233-4f2a-8ea5-a3e459c231c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:00.315800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092786-4233-4f2a-8ea5-a3e459c231c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:00.316075 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092786-4233-4f2a-8ea5-a3e459c231c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:00.334680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c092786-4233-4f2a-8ea5-a3e459c231c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:00.334680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c092786-4233-4f2a-8ea5-a3e459c231c4 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:00.340294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1314/2649] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:01.313854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bffc26-02f7-42dc-8523-21aa21a9a805 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:01.315354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-44bffc26-02f7-42dc-8523-21aa21a9a805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:01.381486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bffc26-02f7-42dc-8523-21aa21a9a805 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:01.386056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:01.386677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:01.386958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:01.387238 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] PATH_INFO: `/v3/users/3643ad79b6d54a2c8f75cd085be6aead` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:01.388383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3643ad79b6d54a2c8f75cd085be6aead)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:01.390278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:01.553116 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092786-4233-4f2a-8ea5-a3e459c231c4 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:01.564742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092786-4233-4f2a-8ea5-a3e459c231c4 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:01.569341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:01.569978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:01.570262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:01.570532 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] PATH_INFO: `/v3/users/5c9806b79993439e995fa7094c4a699e` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:01.571668 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9806b79993439e995fa7094c4a699e)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:01.573788 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:01.680752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3643ad79b6d54a2c8f75cd085be6aead'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:01.681412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3643ad79b6d54a2c8f75cd085be6aead'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:01.787007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3643ad79b6d54a2c8f75cd085be6aead'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:01.787725 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3643ad79b6d54a2c8f75cd085be6aead'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:01.801483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8dede17c-9a74-4e0d-a886-acff0ff7207b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3643ad79b6d54a2c8f75cd085be6aead'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:01.818488 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1336/2650] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:01 2022] DELETE /identity/v3/users/3643ad79b6d54a2c8f75cd085be6aead => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:01.825187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fbe4-a518-4c74-800f-d9625f458682 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:01.825187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fbe4-a518-4c74-800f-d9625f458682 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:01.825187 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fbe4-a518-4c74-800f-d9625f458682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:01.845153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-0c89fbe4-a518-4c74-800f-d9625f458682 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:01.846400 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0c89fbe4-a518-4c74-800f-d9625f458682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:01.867984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:01.910483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1337/2651] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:01.920999 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89fbe4-a518-4c74-800f-d9625f458682 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:01.926278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0c89fbe4-a518-4c74-800f-d9625f458682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:01.980213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9806b79993439e995fa7094c4a699e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:01.981551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89fbe4-a518-4c74-800f-d9625f458682 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:01.986362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5301ce-f1c7-4943-9046-5e96940f952e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:01.986970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5301ce-f1c7-4943-9046-5e96940f952e service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:01.987252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5301ce-f1c7-4943-9046-5e96940f952e service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:01.987527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5301ce-f1c7-4943-9046-5e96940f952e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:01.996852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5301ce-f1c7-4943-9046-5e96940f952e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:02.000749 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5301ce-f1c7-4943-9046-5e96940f952e service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:02.008137 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1338/2652] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:25:02.112468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9806b79993439e995fa7094c4a699e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:02.137857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9806b79993439e995fa7094c4a699e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:02.138581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9806b79993439e995fa7094c4a699e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:02.145297 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9806b79993439e995fa7094c4a699e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:02.152672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1315/2653] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:01 2022] DELETE /identity/v3/users/5c9806b79993439e995fa7094c4a699e => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:02.161565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb89366-3a7f-47b2-886c-6debbccdcf84 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:02.161943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb89366-3a7f-47b2-886c-6debbccdcf84 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:02.162221 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb89366-3a7f-47b2-886c-6debbccdcf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:02.181222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-dcb89366-3a7f-47b2-886c-6debbccdcf84 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:02.182502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-dcb89366-3a7f-47b2-886c-6debbccdcf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:02.256637 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1339/2654] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:02.265450 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:02.267630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:02.276950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03112-3b3a-42ad-bc0e-b0483fa6849e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:02.276950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03112-3b3a-42ad-bc0e-b0483fa6849e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:02.277358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03112-3b3a-42ad-bc0e-b0483fa6849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:02.297694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d9e03112-3b3a-42ad-bc0e-b0483fa6849e None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:02.299047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d9e03112-3b3a-42ad-bc0e-b0483fa6849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:02.322121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:02.343048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1cf2b-e012-4257-9afe-46904d0bb761 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:02.347830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23821ded-c58e-4879-88ed-d8725d4ae023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:02.348562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23821ded-c58e-4879-88ed-d8725d4ae023 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:02.349216 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23821ded-c58e-4879-88ed-d8725d4ae023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:02.349625 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23821ded-c58e-4879-88ed-d8725d4ae023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:02.360199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23821ded-c58e-4879-88ed-d8725d4ae023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:02.361833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23821ded-c58e-4879-88ed-d8725d4ae023 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:02.366929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1340/2655] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:02.373820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1316/2656] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:02.381185 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e03112-3b3a-42ad-bc0e-b0483fa6849e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:02.385722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d9e03112-3b3a-42ad-bc0e-b0483fa6849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:02.455608 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e03112-3b3a-42ad-bc0e-b0483fa6849e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:02.461983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:02.462808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736c924-7913-4966-9712-cbf85fb650d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:02.463589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736c924-7913-4966-9712-cbf85fb650d8 service swift] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:02.463972 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736c924-7913-4966-9712-cbf85fb650d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:02.464248 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736c924-7913-4966-9712-cbf85fb650d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:02.472465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736c924-7913-4966-9712-cbf85fb650d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:02.474046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736c924-7913-4966-9712-cbf85fb650d8 service swift] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:02.482180 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1341/2657] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:25:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:25:02.517159 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23821ded-c58e-4879-88ed-d8725d4ae023 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:02.517636 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-23821ded-c58e-4879-88ed-d8725d4ae023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:02.531550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23821ded-c58e-4879-88ed-d8725d4ae023 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:02.543506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:02.544348 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:02.544761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:02.545142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] PATH_INFO: `/v3/projects/6bf1afed30674e6784be276413fcfdf7` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:02.546434 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf1afed30674e6784be276413fcfdf7)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:02.549214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:02.678009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf1afed30674e6784be276413fcfdf7', 'request_id': 'req-3245915a-8314-4384-8d59-58502e6ffc64'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:02.684985 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf1afed30674e6784be276413fcfdf7', 'request_id': 'req-3245915a-8314-4384-8d59-58502e6ffc64'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:02.752649 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf1afed30674e6784be276413fcfdf7', 'request_id': 'req-3245915a-8314-4384-8d59-58502e6ffc64'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:02.766389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] The token cache is being invalidate because project 6bf1afed30674e6784be276413fcfdf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:02.769291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:02.769291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-3245915a-8314-4384-8d59-58502e6ffc64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:02.769291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1317/2658] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:02 2022] DELETE /identity/v3/projects/6bf1afed30674e6784be276413fcfdf7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:02.773926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e004c-161b-43b3-acce-06060df38a30 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:02.774219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e004c-161b-43b3-acce-06060df38a30 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:02.774679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e004c-161b-43b3-acce-06060df38a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:02.795450 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-743e004c-161b-43b3-acce-06060df38a30 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:02.797036 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-743e004c-161b-43b3-acce-06060df38a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:02.881297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1342/2659] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:02.889278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bb761-bedb-4854-9202-7f02c293a028 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:02.889569 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bb761-bedb-4854-9202-7f02c293a028 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:02.889933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bb761-bedb-4854-9202-7f02c293a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:02.911556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d03bb761-bedb-4854-9202-7f02c293a028 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:02.913013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d03bb761-bedb-4854-9202-7f02c293a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:02.921074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1318/2660] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:02.925358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e004c-161b-43b3-acce-06060df38a30 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:02.936219 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e004c-161b-43b3-acce-06060df38a30 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:02.940904 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:02.941509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:02.941868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:02.942070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:02.942718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:25:02.943045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:02.944627 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:02.957121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1343/2661] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:25:02.961515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bb761-bedb-4854-9202-7f02c293a028 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:02.975430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:02.977413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:02.977929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bb761-bedb-4854-9202-7f02c293a028 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:02.984862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082064b5-e58c-44b4-80c3-921813b9c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:02.985773 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082064b5-e58c-44b4-80c3-921813b9c03a admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:02.986231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082064b5-e58c-44b4-80c3-921813b9c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:02.986568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082064b5-e58c-44b4-80c3-921813b9c03a admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:02.988850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082064b5-e58c-44b4-80c3-921813b9c03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:02.991676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082064b5-e58c-44b4-80c3-921813b9c03a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:02.993804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccbe0a-4134-4b8c-b830-87884de94950 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:03.000551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:03.002105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:03.002105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:03.002105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] PATH_INFO: `/v3/projects/a53c121f4cd842a6be2315489ea48f71` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:03.002884 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53c121f4cd842a6be2315489ea48f71)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:03.004839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:03.081027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1319/2662] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:02 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:03.085351 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082064b5-e58c-44b4-80c3-921813b9c03a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:03.153918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53c121f4cd842a6be2315489ea48f71', 'request_id': 'req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.183162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082064b5-e58c-44b4-80c3-921813b9c03a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:03.255170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53c121f4cd842a6be2315489ea48f71', 'request_id': 'req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.264232 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53c121f4cd842a6be2315489ea48f71', 'request_id': 'req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.276426 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] The token cache is being invalidate because project a53c121f4cd842a6be2315489ea48f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:03.276973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.277685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.279501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1344/2663] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:02 2022] DELETE /identity/v3/projects/a53c121f4cd842a6be2315489ea48f71 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:03.279908 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:03.283283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:03.284741 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:03.285851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f45f3-ea32-426a-9ed5-947cda92ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:03.286866 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f45f3-ea32-426a-9ed5-947cda92ab49 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:03.287236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f45f3-ea32-426a-9ed5-947cda92ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:03.288545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f45f3-ea32-426a-9ed5-947cda92ab49 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:03.288545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f45f3-ea32-426a-9ed5-947cda92ab49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:03.290303 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f45f3-ea32-426a-9ed5-947cda92ab49 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:03.299577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33789b-3bf3-47fb-9b7b-33ebea704cb0 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:03.304801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:03.305436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:03.305722 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:03.306000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] PATH_INFO: `/v3/users/7db8285f1b394bb1aa299590e4edaa52` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:03.307164 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db8285f1b394bb1aa299590e4edaa52)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:03.309294 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:03.320930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:03.405383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1320/2664] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:03 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:03.409524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f45f3-ea32-426a-9ed5-947cda92ab49 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:03.411191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8c9f45f3-ea32-426a-9ed5-947cda92ab49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:03.423934 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f45f3-ea32-426a-9ed5-947cda92ab49 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:03.429034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c54f4f-3139-405d-bee0-964c97f8d6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:03.429709 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c54f4f-3139-405d-bee0-964c97f8d6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:03.429992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c54f4f-3139-405d-bee0-964c97f8d6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:03.437179 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c54f4f-3139-405d-bee0-964c97f8d6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:03.437179 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c54f4f-3139-405d-bee0-964c97f8d6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:03.437179 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c54f4f-3139-405d-bee0-964c97f8d6b7 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:03.442767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1321/2665] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:25:03.446870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c54f4f-3139-405d-bee0-964c97f8d6b7 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:03.457762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c54f4f-3139-405d-bee0-964c97f8d6b7 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:03.462497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793eb75-a494-4f84-a72f-9033dd3b72c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:03.463608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793eb75-a494-4f84-a72f-9033dd3b72c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:03.463916 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793eb75-a494-4f84-a72f-9033dd3b72c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:03.471647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793eb75-a494-4f84-a72f-9033dd3b72c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:03.471647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793eb75-a494-4f84-a72f-9033dd3b72c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:03.471647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793eb75-a494-4f84-a72f-9033dd3b72c2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:03.477010 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1322/2666] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:25:03.481735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793eb75-a494-4f84-a72f-9033dd3b72c2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:03.491508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793eb75-a494-4f84-a72f-9033dd3b72c2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:03.496310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29643a05-f003-41c5-96e9-9c0bc4a31f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:03.496948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29643a05-f003-41c5-96e9-9c0bc4a31f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:03.497230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29643a05-f003-41c5-96e9-9c0bc4a31f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:03.497506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29643a05-f003-41c5-96e9-9c0bc4a31f40 admin admin] PATH_INFO: `/v3/projects/3c48a0b11a2d42fab313b685352f5045/users/ad25fb3f0d3a4d5b9ea8e549c9b30b50/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:03.512247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29643a05-f003-41c5-96e9-9c0bc4a31f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c48a0b11a2d42fab313b685352f5045, user_id=ad25fb3f0d3a4d5b9ea8e549c9b30b50, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:03.514873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29643a05-f003-41c5-96e9-9c0bc4a31f40 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:03.527267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db8285f1b394bb1aa299590e4edaa52'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.529120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db8285f1b394bb1aa299590e4edaa52'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.576654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1323/2667] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:03 2022] PUT /identity/v3/projects/3c48a0b11a2d42fab313b685352f5045/users/ad25fb3f0d3a4d5b9ea8e549c9b30b50/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:03.587192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4536-d097-492a-90a5-721e04c061d9 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:03.587483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4536-d097-492a-90a5-721e04c061d9 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:03.587803 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4536-d097-492a-90a5-721e04c061d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:03.604520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db8285f1b394bb1aa299590e4edaa52'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.605855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db8285f1b394bb1aa299590e4edaa52'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.620038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-0c5f4536-d097-492a-90a5-721e04c061d9 None None] MFA Rules not processed for user `ad25fb3f0d3a4d5b9ea8e549c9b30b50`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:03.620268 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db8285f1b394bb1aa299590e4edaa52'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:03.621267 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0c5f4536-d097-492a-90a5-721e04c061d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:03.639009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1345/2668] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:03 2022] DELETE /identity/v3/users/7db8285f1b394bb1aa299590e4edaa52 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:03.690705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1324/2669] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:03.695304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:03.696747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:03.771717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc17a49-95a0-4fda-85c4-f5750c7809a5 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:03.776987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c7510-cef4-4fa3-b996-14ae309604e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:03.777598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c7510-cef4-4fa3-b996-14ae309604e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:03.777877 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c7510-cef4-4fa3-b996-14ae309604e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:03.778148 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c7510-cef4-4fa3-b996-14ae309604e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:03.778785 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c7510-cef4-4fa3-b996-14ae309604e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:03.780697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c7510-cef4-4fa3-b996-14ae309604e9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:03.904172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1346/2670] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:03 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:03.908353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4536-d097-492a-90a5-721e04c061d9 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:04.100787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4536-d097-492a-90a5-721e04c061d9 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:04.179862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef02c1c-00eb-44c4-b8ab-47fadf7e8b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:04.180564 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef02c1c-00eb-44c4-b8ab-47fadf7e8b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.180930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef02c1c-00eb-44c4-b8ab-47fadf7e8b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.181301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef02c1c-00eb-44c4-b8ab-47fadf7e8b54 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.182559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef02c1c-00eb-44c4-b8ab-47fadf7e8b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:04.184733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef02c1c-00eb-44c4-b8ab-47fadf7e8b54 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:04.276808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c7510-cef4-4fa3-b996-14ae309604e9 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:04.276808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fd2c7510-cef4-4fa3-b996-14ae309604e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:04.285745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c7510-cef4-4fa3-b996-14ae309604e9 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:04.304573 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:04.306088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.306483 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.307535 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] PATH_INFO: `/v3/projects/d171b51009574164b9fbc2a5d7958010` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.309010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d171b51009574164b9fbc2a5d7958010)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:04.311557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:04.322732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1325/2671] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:03 2022] POST /identity/v3/users => generated 288 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:04.326794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef02c1c-00eb-44c4-b8ab-47fadf7e8b54 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:04.345476 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef02c1c-00eb-44c4-b8ab-47fadf7e8b54 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:04.352508 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc7c77-8fd9-46d9-a176-23672aba2a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:04.353304 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc7c77-8fd9-46d9-a176-23672aba2a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.354381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc7c77-8fd9-46d9-a176-23672aba2a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.354815 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc7c77-8fd9-46d9-a176-23672aba2a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.355733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc7c77-8fd9-46d9-a176-23672aba2a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:04.357756 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc7c77-8fd9-46d9-a176-23672aba2a84 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:04.370497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1326/2672] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:04.374109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc7c77-8fd9-46d9-a176-23672aba2a84 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:04.383039 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:04.387989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc7c77-8fd9-46d9-a176-23672aba2a84 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:04.404720 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e81e86-54fc-4c42-9962-e55dce046f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:04.405405 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e81e86-54fc-4c42-9962-e55dce046f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.405694 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e81e86-54fc-4c42-9962-e55dce046f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.405966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e81e86-54fc-4c42-9962-e55dce046f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.406775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e81e86-54fc-4c42-9962-e55dce046f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:04.408708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e81e86-54fc-4c42-9962-e55dce046f47 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:04.419686 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1327/2673] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:04.423996 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e81e86-54fc-4c42-9962-e55dce046f47 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:04.436881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e81e86-54fc-4c42-9962-e55dce046f47 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:04.441595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d693475-fa22-4155-b664-793cc5834ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:04.442284 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d693475-fa22-4155-b664-793cc5834ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.442562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d693475-fa22-4155-b664-793cc5834ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.442830 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d693475-fa22-4155-b664-793cc5834ffa admin admin] PATH_INFO: `/v3/projects/8f505e9c71b14f85af92e5dcc541ea6c/users/8025f7541b834858a8893dc572dce8eb/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.460864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d693475-fa22-4155-b664-793cc5834ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f505e9c71b14f85af92e5dcc541ea6c, user_id=8025f7541b834858a8893dc572dce8eb, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:04.464608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d693475-fa22-4155-b664-793cc5834ffa admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:04.581499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1328/2674] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:04 2022] PUT /identity/v3/projects/8f505e9c71b14f85af92e5dcc541ea6c/users/8025f7541b834858a8893dc572dce8eb/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:04.590552 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd171b51009574164b9fbc2a5d7958010', 'request_id': 'req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:04.593970 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a284-fdb5-4d8e-a887-8a871a8bba7d None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.594253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a284-fdb5-4d8e-a887-8a871a8bba7d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.594527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a284-fdb5-4d8e-a887-8a871a8bba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.624302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-cc12a284-fdb5-4d8e-a887-8a871a8bba7d None None] MFA Rules not processed for user `8025f7541b834858a8893dc572dce8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:04.625522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cc12a284-fdb5-4d8e-a887-8a871a8bba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:04.676855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd171b51009574164b9fbc2a5d7958010', 'request_id': 'req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:04.685229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd171b51009574164b9fbc2a5d7958010', 'request_id': 'req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:04.693139 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:04.696171 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1329/2675] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:04.701144 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12a284-fdb5-4d8e-a887-8a871a8bba7d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:04.704477 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] The token cache is being invalidate because project d171b51009574164b9fbc2a5d7958010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:04.704773 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:04.705439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d987e5bf-ad3b-49d2-a26d-a4d0adf65222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:04.707197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1347/2676] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:04 2022] DELETE /identity/v3/projects/d171b51009574164b9fbc2a5d7958010 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:04.712867 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9153ec-0346-4893-83cc-1c019bfd995c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.713430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9153ec-0346-4893-83cc-1c019bfd995c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.715116 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9153ec-0346-4893-83cc-1c019bfd995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.735708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9d9153ec-0346-4893-83cc-1c019bfd995c None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:04.736934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9d9153ec-0346-4893-83cc-1c019bfd995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:04.774244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12a284-fdb5-4d8e-a887-8a871a8bba7d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:04.780946 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c177e-a988-4dfe-8eeb-5e03c11d622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:04.781560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c177e-a988-4dfe-8eeb-5e03c11d622f admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.781841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c177e-a988-4dfe-8eeb-5e03c11d622f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.782120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c177e-a988-4dfe-8eeb-5e03c11d622f admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.783118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c177e-a988-4dfe-8eeb-5e03c11d622f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:04.785800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c177e-a988-4dfe-8eeb-5e03c11d622f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:04.806052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1348/2677] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:04.817153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee398edf-0bb3-4ec4-b209-9fa098e04f55 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.817153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee398edf-0bb3-4ec4-b209-9fa098e04f55 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.817533 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee398edf-0bb3-4ec4-b209-9fa098e04f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.840078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ee398edf-0bb3-4ec4-b209-9fa098e04f55 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:04.841297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ee398edf-0bb3-4ec4-b209-9fa098e04f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:04.849384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1349/2678] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:04.853663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee398edf-0bb3-4ec4-b209-9fa098e04f55 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:04.863699 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee398edf-0bb3-4ec4-b209-9fa098e04f55 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:04.868953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4908e-00e0-46c2-82ec-734c876e0bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:04.869623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4908e-00e0-46c2-82ec-734c876e0bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.869900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4908e-00e0-46c2-82ec-734c876e0bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.870174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4908e-00e0-46c2-82ec-734c876e0bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.871075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4908e-00e0-46c2-82ec-734c876e0bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:25:04.871372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4908e-00e0-46c2-82ec-734c876e0bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:04.873128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4908e-00e0-46c2-82ec-734c876e0bfe admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:04.885112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1350/2679] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:25:04.889634 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4908e-00e0-46c2-82ec-734c876e0bfe admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:04.902026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4908e-00e0-46c2-82ec-734c876e0bfe admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:04.903570 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1330/2680] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:04 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:25:04.907524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c177e-a988-4dfe-8eeb-5e03c11d622f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:04.909311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2d4c177e-a988-4dfe-8eeb-5e03c11d622f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:04.969157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5173f-332e-4a97-8974-75f4b898049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:04.969775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5173f-332e-4a97-8974-75f4b898049c admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.970056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5173f-332e-4a97-8974-75f4b898049c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.970401 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5173f-332e-4a97-8974-75f4b898049c admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.970952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5173f-332e-4a97-8974-75f4b898049c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:04.972876 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5173f-332e-4a97-8974-75f4b898049c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:04.985951 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c177e-a988-4dfe-8eeb-5e03c11d622f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:04.990747 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dad42b-3580-4a0c-af12-d1c03f31c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:04.993430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dad42b-3580-4a0c-af12-d1c03f31c99c admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:04.993430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dad42b-3580-4a0c-af12-d1c03f31c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:04.993430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dad42b-3580-4a0c-af12-d1c03f31c99c admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:04.993430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dad42b-3580-4a0c-af12-d1c03f31c99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:04.994480 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dad42b-3580-4a0c-af12-d1c03f31c99c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.051910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1351/2681] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:04 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:25:05.055928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5173f-332e-4a97-8974-75f4b898049c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.077282 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1331/2682] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:04 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:05.095462 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dad42b-3580-4a0c-af12-d1c03f31c99c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.112120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dad42b-3580-4a0c-af12-d1c03f31c99c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.142162 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5173f-332e-4a97-8974-75f4b898049c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.148622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd07ea-630a-4d97-b09f-44ef41d70f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.149717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd07ea-630a-4d97-b09f-44ef41d70f35 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.149717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd07ea-630a-4d97-b09f-44ef41d70f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.149948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd07ea-630a-4d97-b09f-44ef41d70f35 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.150593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd07ea-630a-4d97-b09f-44ef41d70f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.152760 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd07ea-630a-4d97-b09f-44ef41d70f35 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.186398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef30ff4-1634-4153-86d3-4b8110fc2af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.187426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef30ff4-1634-4153-86d3-4b8110fc2af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.187873 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef30ff4-1634-4153-86d3-4b8110fc2af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.188272 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef30ff4-1634-4153-86d3-4b8110fc2af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.189921 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef30ff4-1634-4153-86d3-4b8110fc2af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.191428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef30ff4-1634-4153-86d3-4b8110fc2af5 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.204220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1332/2683] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:05.208770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef30ff4-1634-4153-86d3-4b8110fc2af5 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.219459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef30ff4-1634-4153-86d3-4b8110fc2af5 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.224696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964143f-4352-40bc-a1d3-d3d572ab8892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.226960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964143f-4352-40bc-a1d3-d3d572ab8892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.226960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964143f-4352-40bc-a1d3-d3d572ab8892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.226960 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964143f-4352-40bc-a1d3-d3d572ab8892 admin admin] PATH_INFO: `/v3/projects/1104b2ef04844bd48ee070c17dfaf6bb/users/207246c45c5c4eb4b23409d29b2327ab/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.244311 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964143f-4352-40bc-a1d3-d3d572ab8892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1104b2ef04844bd48ee070c17dfaf6bb, user_id=207246c45c5c4eb4b23409d29b2327ab, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.247487 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964143f-4352-40bc-a1d3-d3d572ab8892 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.295772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:05.305041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1352/2684] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:05 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:25:05.306598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd07ea-630a-4d97-b09f-44ef41d70f35 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.317567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd07ea-630a-4d97-b09f-44ef41d70f35 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.322706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55671e2-088e-42e4-b2fe-b2250836a99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.323352 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55671e2-088e-42e4-b2fe-b2250836a99e admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.323670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55671e2-088e-42e4-b2fe-b2250836a99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.323946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55671e2-088e-42e4-b2fe-b2250836a99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.324598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55671e2-088e-42e4-b2fe-b2250836a99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.326227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55671e2-088e-42e4-b2fe-b2250836a99e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.334956 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1333/2685] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:05 2022] PUT /identity/v3/projects/1104b2ef04844bd48ee070c17dfaf6bb/users/207246c45c5c4eb4b23409d29b2327ab/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:05.336654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964143f-4352-40bc-a1d3-d3d572ab8892 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.340759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1353/2686] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:25:05.341852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55671e2-088e-42e4-b2fe-b2250836a99e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.356181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55671e2-088e-42e4-b2fe-b2250836a99e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.426465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2b1d4-20c1-40d7-a6ae-469770410a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.427568 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b1d4-20c1-40d7-a6ae-469770410a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.428001 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b1d4-20c1-40d7-a6ae-469770410a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.428371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b1d4-20c1-40d7-a6ae-469770410a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.428947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964143f-4352-40bc-a1d3-d3d572ab8892 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.429151 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2b1d4-20c1-40d7-a6ae-469770410a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.430958 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2b1d4-20c1-40d7-a6ae-469770410a80 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.436301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a87ce8-3f06-4808-9cd9-f7a0f0a08fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.439042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a87ce8-3f06-4808-9cd9-f7a0f0a08fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.439042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a87ce8-3f06-4808-9cd9-f7a0f0a08fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.439042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a87ce8-3f06-4808-9cd9-f7a0f0a08fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.439042 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a87ce8-3f06-4808-9cd9-f7a0f0a08fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.440957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a87ce8-3f06-4808-9cd9-f7a0f0a08fcf admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.442977 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1354/2687] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:25:05.447090 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2b1d4-20c1-40d7-a6ae-469770410a80 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.453530 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1334/2688] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:05.457909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a87ce8-3f06-4808-9cd9-f7a0f0a08fcf admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.460558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2b1d4-20c1-40d7-a6ae-469770410a80 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.467838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea265f-5f68-4ae0-bcff-1a4e8de314a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.468603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea265f-5f68-4ae0-bcff-1a4e8de314a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.468894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea265f-5f68-4ae0-bcff-1a4e8de314a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.470963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea265f-5f68-4ae0-bcff-1a4e8de314a6 admin admin] PATH_INFO: `/v3/projects/0b94fa83ee234b1197f6ea9eb212c56d/users/3e09c3d207a5486088134d0feec81569/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.475485 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a87ce8-3f06-4808-9cd9-f7a0f0a08fcf admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.481792 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd296eda-2659-4c68-820b-dc1982754058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.483020 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd296eda-2659-4c68-820b-dc1982754058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.483223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd296eda-2659-4c68-820b-dc1982754058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.483495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd296eda-2659-4c68-820b-dc1982754058 admin admin] PATH_INFO: `/v3/projects/1104b2ef04844bd48ee070c17dfaf6bb/users/207246c45c5c4eb4b23409d29b2327ab/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.485766 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd296eda-2659-4c68-820b-dc1982754058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1104b2ef04844bd48ee070c17dfaf6bb, user_id=207246c45c5c4eb4b23409d29b2327ab, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.487898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea265f-5f68-4ae0-bcff-1a4e8de314a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b94fa83ee234b1197f6ea9eb212c56d, user_id=3e09c3d207a5486088134d0feec81569, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.488734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd296eda-2659-4c68-820b-dc1982754058 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.490791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea265f-5f68-4ae0-bcff-1a4e8de314a6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.500937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1335/2689] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:05 2022] PUT /identity/v3/projects/1104b2ef04844bd48ee070c17dfaf6bb/users/207246c45c5c4eb4b23409d29b2327ab/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:05.511332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32481d49-8d2b-403e-b62d-4918ad61b45c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.511639 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32481d49-8d2b-403e-b62d-4918ad61b45c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.511922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32481d49-8d2b-403e-b62d-4918ad61b45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.542818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-32481d49-8d2b-403e-b62d-4918ad61b45c None None] MFA Rules not processed for user `207246c45c5c4eb4b23409d29b2327ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:05.544083 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-32481d49-8d2b-403e-b62d-4918ad61b45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:05.587312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1355/2690] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:05 2022] PUT /identity/v3/projects/0b94fa83ee234b1197f6ea9eb212c56d/users/3e09c3d207a5486088134d0feec81569/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:05.600169 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd941bd-bc53-4945-8791-59b4a64371e4 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.600841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd941bd-bc53-4945-8791-59b4a64371e4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.600929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd941bd-bc53-4945-8791-59b4a64371e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.626391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1336/2691] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:05.637257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-ebd941bd-bc53-4945-8791-59b4a64371e4 None None] MFA Rules not processed for user `3e09c3d207a5486088134d0feec81569`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:05.638603 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ebd941bd-bc53-4945-8791-59b4a64371e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:05.641847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32481d49-8d2b-403e-b62d-4918ad61b45c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.645361 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-32481d49-8d2b-403e-b62d-4918ad61b45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:05.692584 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:05.722455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1356/2692] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:05.732258 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd941bd-bc53-4945-8791-59b4a64371e4 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:05.733813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-ebd941bd-bc53-4945-8791-59b4a64371e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:05.739007 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32481d49-8d2b-403e-b62d-4918ad61b45c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.797113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e66f52-7b01-4da5-9a20-424da0baf7dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.797735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e66f52-7b01-4da5-9a20-424da0baf7dc service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.798015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e66f52-7b01-4da5-9a20-424da0baf7dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.798287 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e66f52-7b01-4da5-9a20-424da0baf7dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.799934 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd941bd-bc53-4945-8791-59b4a64371e4 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:05.800153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c0e66f52-7b01-4da5-9a20-424da0baf7dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:05.803739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbade6-e734-47ec-957c-699489262573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:05.804383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbade6-e734-47ec-957c-699489262573 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:05.804662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbade6-e734-47ec-957c-699489262573 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:05.804938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbade6-e734-47ec-957c-699489262573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:05.816260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbade6-e734-47ec-957c-699489262573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.818723 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbade6-e734-47ec-957c-699489262573 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.834542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1357/2693] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:25:05.886975 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e66f52-7b01-4da5-9a20-424da0baf7dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:05.888460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e66f52-7b01-4da5-9a20-424da0baf7dc service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:05.895087 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:05.900406 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1337/2694] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:25:06.038712 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:06.176289 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:08.047171 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbade6-e734-47ec-957c-699489262573 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:08.056292 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbade6-e734-47ec-957c-699489262573 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:08.060695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6197-c6df-4105-9d08-0fbcd67aca44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:08.061370 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6197-c6df-4105-9d08-0fbcd67aca44 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:08.061757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6197-c6df-4105-9d08-0fbcd67aca44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:08.062106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6197-c6df-4105-9d08-0fbcd67aca44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:08.064015 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-4e2d6197-c6df-4105-9d08-0fbcd67aca44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:08.147946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d6197-c6df-4105-9d08-0fbcd67aca44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:08.149390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d6197-c6df-4105-9d08-0fbcd67aca44 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:08.159353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1358/2695] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:09.894062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e66f52-7b01-4da5-9a20-424da0baf7dc service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:09.904976 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e66f52-7b01-4da5-9a20-424da0baf7dc service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:09.908840 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13468733-4640-499c-b356-020ebd20107c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:09.909453 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13468733-4640-499c-b356-020ebd20107c service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:09.909925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13468733-4640-499c-b356-020ebd20107c service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:09.910211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13468733-4640-499c-b356-020ebd20107c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:09.981871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13468733-4640-499c-b356-020ebd20107c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:09.988608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13468733-4640-499c-b356-020ebd20107c service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:10.008536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1338/2696] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:13.067534 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6197-c6df-4105-9d08-0fbcd67aca44 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:13.140803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6197-c6df-4105-9d08-0fbcd67aca44 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:13.149446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:13.152371 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:13.152658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:13.155358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] PATH_INFO: `/v3/users/3e09c3d207a5486088134d0feec81569` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:13.158378 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e09c3d207a5486088134d0feec81569)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:13.160349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:13.414086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e09c3d207a5486088134d0feec81569'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:13.414839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e09c3d207a5486088134d0feec81569'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:13.488337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e09c3d207a5486088134d0feec81569'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:13.489007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e09c3d207a5486088134d0feec81569'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:13.496743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e09c3d207a5486088134d0feec81569'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:13.514527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1359/2697] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:13 2022] DELETE /identity/v3/users/3e09c3d207a5486088134d0feec81569 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:13.519003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2c0d5-6cee-4821-8afb-c205d328a00a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:13.519499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2c0d5-6cee-4821-8afb-c205d328a00a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:13.519613 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2c0d5-6cee-4821-8afb-c205d328a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:13.538791 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-9df2c0d5-6cee-4821-8afb-c205d328a00a None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:13.540024 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9df2c0d5-6cee-4821-8afb-c205d328a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:13.604051 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1339/2698] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:13.613881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:13.615300 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:13.621332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:13.693095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d67d8-4ed6-4d90-ac08-8b4b5b38e7ca admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:13.696978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fe2bd-173e-447f-8aff-788735e60d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:13.697613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fe2bd-173e-447f-8aff-788735e60d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:13.697864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fe2bd-173e-447f-8aff-788735e60d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:13.698143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fe2bd-173e-447f-8aff-788735e60d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:13.708998 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fe2bd-173e-447f-8aff-788735e60d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:13.710612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fe2bd-173e-447f-8aff-788735e60d66 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:13.720758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1360/2699] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:14.140294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2c0d5-6cee-4821-8afb-c205d328a00a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:14.142011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9df2c0d5-6cee-4821-8afb-c205d328a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:14.157328 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2c0d5-6cee-4821-8afb-c205d328a00a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:14.163445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:14.164147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.164426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.164755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] PATH_INFO: `/v3/projects/0b94fa83ee234b1197f6ea9eb212c56d` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.165907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b94fa83ee234b1197f6ea9eb212c56d)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:14.169155 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:14.277443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b94fa83ee234b1197f6ea9eb212c56d', 'request_id': 'req-4b890850-9b52-4685-ae91-b90d8cba372a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:14.278605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:14.284844 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b94fa83ee234b1197f6ea9eb212c56d', 'request_id': 'req-4b890850-9b52-4685-ae91-b90d8cba372a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:14.375856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b94fa83ee234b1197f6ea9eb212c56d', 'request_id': 'req-4b890850-9b52-4685-ae91-b90d8cba372a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:14.389674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] The token cache is being invalidate because project 0b94fa83ee234b1197f6ea9eb212c56d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:14.389962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:14.390718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-4b890850-9b52-4685-ae91-b90d8cba372a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:14.392630 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1340/2700] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:14 2022] DELETE /identity/v3/projects/0b94fa83ee234b1197f6ea9eb212c56d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:14.397566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c298a4-85d5-472b-9447-13c3e990e7fd None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.398095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c298a4-85d5-472b-9447-13c3e990e7fd None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.398095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c298a4-85d5-472b-9447-13c3e990e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.418548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b6c298a4-85d5-472b-9447-13c3e990e7fd None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:14.419567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b6c298a4-85d5-472b-9447-13c3e990e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:14.486707 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1361/2701] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:14.494628 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aeca9-d1f8-401f-8a35-292dc7ef5913 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.494988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aeca9-d1f8-401f-8a35-292dc7ef5913 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.495893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aeca9-d1f8-401f-8a35-292dc7ef5913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.517292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-106aeca9-d1f8-401f-8a35-292dc7ef5913 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:14.518507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-106aeca9-d1f8-401f-8a35-292dc7ef5913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:14.529989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1341/2702] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:14.539818 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c298a4-85d5-472b-9447-13c3e990e7fd None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:14.549864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c298a4-85d5-472b-9447-13c3e990e7fd None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:14.555071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280f29c-f4c3-4d6c-90e8-e86597d19fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:14.555704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280f29c-f4c3-4d6c-90e8-e86597d19fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.555985 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280f29c-f4c3-4d6c-90e8-e86597d19fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.556388 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280f29c-f4c3-4d6c-90e8-e86597d19fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.557034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280f29c-f4c3-4d6c-90e8-e86597d19fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:25:14.557337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280f29c-f4c3-4d6c-90e8-e86597d19fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:14.559536 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280f29c-f4c3-4d6c-90e8-e86597d19fa1 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:14.575987 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1362/2703] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:25:14.584757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aeca9-d1f8-401f-8a35-292dc7ef5913 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:14.593888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aeca9-d1f8-401f-8a35-292dc7ef5913 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:14.598592 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c835bd7-0276-4ff0-a57b-3fcdaa0b711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:14.599198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c835bd7-0276-4ff0-a57b-3fcdaa0b711f admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.599484 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c835bd7-0276-4ff0-a57b-3fcdaa0b711f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.599789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c835bd7-0276-4ff0-a57b-3fcdaa0b711f admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.600440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c835bd7-0276-4ff0-a57b-3fcdaa0b711f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:14.602391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c835bd7-0276-4ff0-a57b-3fcdaa0b711f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:14.715211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1342/2704] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:14 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:14.719460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280f29c-f4c3-4d6c-90e8-e86597d19fa1 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:14.733563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280f29c-f4c3-4d6c-90e8-e86597d19fa1 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:14.796801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7293e1f-0c6c-4e1f-9bb8-4252e9f226ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:14.797508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7293e1f-0c6c-4e1f-9bb8-4252e9f226ca admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.797798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7293e1f-0c6c-4e1f-9bb8-4252e9f226ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.798073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7293e1f-0c6c-4e1f-9bb8-4252e9f226ca admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.798435 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c835bd7-0276-4ff0-a57b-3fcdaa0b711f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:14.798724 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7293e1f-0c6c-4e1f-9bb8-4252e9f226ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:14.800577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0c835bd7-0276-4ff0-a57b-3fcdaa0b711f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:14.800694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7293e1f-0c6c-4e1f-9bb8-4252e9f226ca admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:14.813100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c835bd7-0276-4ff0-a57b-3fcdaa0b711f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:14.817740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:14.827465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.827465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.827465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] PATH_INFO: `/v3/users/ad25fb3f0d3a4d5b9ea8e549c9b30b50` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.827465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad25fb3f0d3a4d5b9ea8e549c9b30b50)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:14.827465 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:14.891342 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1363/2705] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:14 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:14.897312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7293e1f-0c6c-4e1f-9bb8-4252e9f226ca admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:14.908779 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7293e1f-0c6c-4e1f-9bb8-4252e9f226ca admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:14.914380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeaa717-136b-4758-83ac-a35cad98be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:14.915102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeaa717-136b-4758-83ac-a35cad98be00 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.915356 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeaa717-136b-4758-83ac-a35cad98be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.915743 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeaa717-136b-4758-83ac-a35cad98be00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.916590 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeaa717-136b-4758-83ac-a35cad98be00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:14.918253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeaa717-136b-4758-83ac-a35cad98be00 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:14.932228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1364/2706] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:25:14.936644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeaa717-136b-4758-83ac-a35cad98be00 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:14.947942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeaa717-136b-4758-83ac-a35cad98be00 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:14.953419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c24d0d-cb1a-4604-b01b-1f008af3caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:14.954018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c24d0d-cb1a-4604-b01b-1f008af3caed admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.954301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c24d0d-cb1a-4604-b01b-1f008af3caed admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.954576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c24d0d-cb1a-4604-b01b-1f008af3caed admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.955215 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c24d0d-cb1a-4604-b01b-1f008af3caed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:14.957084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c24d0d-cb1a-4604-b01b-1f008af3caed admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:14.962612 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:14.968251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1365/2707] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:14.972360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c24d0d-cb1a-4604-b01b-1f008af3caed admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:14.982681 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c24d0d-cb1a-4604-b01b-1f008af3caed admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:14.987463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b4449-a048-4d5d-84bd-255994e5ef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:14.988136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b4449-a048-4d5d-84bd-255994e5ef31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:14.988424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b4449-a048-4d5d-84bd-255994e5ef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:14.989062 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b4449-a048-4d5d-84bd-255994e5ef31 admin admin] PATH_INFO: `/v3/projects/a08a9325f35243d082e9135eabf44f8e/users/0b246677d943427e8a6221d8c31d0a90/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:14.994616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad25fb3f0d3a4d5b9ea8e549c9b30b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:15.004633 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b4449-a048-4d5d-84bd-255994e5ef31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08a9325f35243d082e9135eabf44f8e, user_id=0b246677d943427e8a6221d8c31d0a90, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:15.015944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b4449-a048-4d5d-84bd-255994e5ef31 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:15.072332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad25fb3f0d3a4d5b9ea8e549c9b30b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:15.085859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad25fb3f0d3a4d5b9ea8e549c9b30b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:15.086587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad25fb3f0d3a4d5b9ea8e549c9b30b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:15.093878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-f8752ab8-d673-4171-95f7-a8a1790ed6f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad25fb3f0d3a4d5b9ea8e549c9b30b50'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:15.100176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1343/2708] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:14 2022] DELETE /identity/v3/users/ad25fb3f0d3a4d5b9ea8e549c9b30b50 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:15.105190 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d9639-7420-4516-8ef6-9dc3e8649a0e None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.105823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d9639-7420-4516-8ef6-9dc3e8649a0e None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.106269 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d9639-7420-4516-8ef6-9dc3e8649a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.124837 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1366/2709] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:14 2022] PUT /identity/v3/projects/a08a9325f35243d082e9135eabf44f8e/users/0b246677d943427e8a6221d8c31d0a90/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:15.135427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e1c78-efa7-499e-a4b7-72c69bbf51d2 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.136154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e1c78-efa7-499e-a4b7-72c69bbf51d2 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.136505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e1c78-efa7-499e-a4b7-72c69bbf51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.137725 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e42d9639-7420-4516-8ef6-9dc3e8649a0e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:15.138050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e42d9639-7420-4516-8ef6-9dc3e8649a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:15.169195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6f4e1c78-efa7-499e-a4b7-72c69bbf51d2 None None] MFA Rules not processed for user `0b246677d943427e8a6221d8c31d0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:15.170417 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6f4e1c78-efa7-499e-a4b7-72c69bbf51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:15.219951 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1344/2710] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:15.231286 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d9639-7420-4516-8ef6-9dc3e8649a0e None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:15.232857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e42d9639-7420-4516-8ef6-9dc3e8649a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:15.243506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1367/2711] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:15.248035 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e1c78-efa7-499e-a4b7-72c69bbf51d2 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:15.249366 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6f4e1c78-efa7-499e-a4b7-72c69bbf51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:15.264418 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:15.266055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e1c78-efa7-499e-a4b7-72c69bbf51d2 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:15.270719 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a5c6-512e-479f-bef6-defc58c71302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:15.271370 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a5c6-512e-479f-bef6-defc58c71302 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.271674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a5c6-512e-479f-bef6-defc58c71302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.271945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a5c6-512e-479f-bef6-defc58c71302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.272574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9a5c6-512e-479f-bef6-defc58c71302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:15.274446 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9a5c6-512e-479f-bef6-defc58c71302 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:15.290962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d9639-7420-4516-8ef6-9dc3e8649a0e None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:15.295496 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e385f-1a8e-4b54-b138-d94676efbd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:15.302066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e385f-1a8e-4b54-b138-d94676efbd0b service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.302066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e385f-1a8e-4b54-b138-d94676efbd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.302066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e385f-1a8e-4b54-b138-d94676efbd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.305863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e385f-1a8e-4b54-b138-d94676efbd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:15.307275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e385f-1a8e-4b54-b138-d94676efbd0b service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:15.317202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1345/2712] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:25:15.359677 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1368/2713] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:15 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:25:15.363896 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e385f-1a8e-4b54-b138-d94676efbd0b service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:15.374646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e385f-1a8e-4b54-b138-d94676efbd0b service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:15.431852 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62e6f-d5ea-46ba-9acc-ffee262bb85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:15.432472 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62e6f-d5ea-46ba-9acc-ffee262bb85e admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.433296 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62e6f-d5ea-46ba-9acc-ffee262bb85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.433571 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62e6f-d5ea-46ba-9acc-ffee262bb85e admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.434196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62e6f-d5ea-46ba-9acc-ffee262bb85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:15.436134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62e6f-d5ea-46ba-9acc-ffee262bb85e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:15.519910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1346/2714] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:15 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:15.523923 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a5c6-512e-479f-bef6-defc58c71302 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:15.536230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a5c6-512e-479f-bef6-defc58c71302 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:15.541848 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb4f8b-59cc-4837-b96c-90935f5776ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:15.543015 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb4f8b-59cc-4837-b96c-90935f5776ab admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.543381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb4f8b-59cc-4837-b96c-90935f5776ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.543694 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb4f8b-59cc-4837-b96c-90935f5776ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.544409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb4f8b-59cc-4837-b96c-90935f5776ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:15.546096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb4f8b-59cc-4837-b96c-90935f5776ab admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:15.557006 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1369/2715] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:15.561659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62e6f-d5ea-46ba-9acc-ffee262bb85e admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:15.573058 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62e6f-d5ea-46ba-9acc-ffee262bb85e admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:15.577838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96d28-c678-41b3-a6ca-26080955f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:15.578468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96d28-c678-41b3-a6ca-26080955f007 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.578752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96d28-c678-41b3-a6ca-26080955f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.579028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96d28-c678-41b3-a6ca-26080955f007 admin admin] PATH_INFO: `/v3/projects/bc7c7e3a1f2f4020be5fcacd15180f40/users/8ec6096d799746b782298657b2fab198/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.594707 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96d28-c678-41b3-a6ca-26080955f007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7c7e3a1f2f4020be5fcacd15180f40, user_id=8ec6096d799746b782298657b2fab198, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:15.597468 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96d28-c678-41b3-a6ca-26080955f007 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:15.663115 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1347/2716] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:15 2022] PUT /identity/v3/projects/bc7c7e3a1f2f4020be5fcacd15180f40/users/8ec6096d799746b782298657b2fab198/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:15.667325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb4f8b-59cc-4837-b96c-90935f5776ab admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:15.678837 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb4f8b-59cc-4837-b96c-90935f5776ab admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:15.746359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f91d5-7c5b-41fd-83e2-b46b9f8e9ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:15.746881 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f91d5-7c5b-41fd-83e2-b46b9f8e9ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.747161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f91d5-7c5b-41fd-83e2-b46b9f8e9ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.747431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f91d5-7c5b-41fd-83e2-b46b9f8e9ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.748107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f91d5-7c5b-41fd-83e2-b46b9f8e9ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:15.749669 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f91d5-7c5b-41fd-83e2-b46b9f8e9ac8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:15.761323 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1370/2717] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:15.765685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96d28-c678-41b3-a6ca-26080955f007 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:15.777212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96d28-c678-41b3-a6ca-26080955f007 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:15.781886 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03694c76-5035-4563-a7c1-2c622422c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:15.782528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03694c76-5035-4563-a7c1-2c622422c5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.782809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03694c76-5035-4563-a7c1-2c622422c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.783082 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03694c76-5035-4563-a7c1-2c622422c5e4 admin admin] PATH_INFO: `/v3/projects/bc7c7e3a1f2f4020be5fcacd15180f40/users/8ec6096d799746b782298657b2fab198/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.785015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03694c76-5035-4563-a7c1-2c622422c5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7c7e3a1f2f4020be5fcacd15180f40, user_id=8ec6096d799746b782298657b2fab198, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:15.787597 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03694c76-5035-4563-a7c1-2c622422c5e4 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:15.798447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1348/2718] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:15 2022] PUT /identity/v3/projects/bc7c7e3a1f2f4020be5fcacd15180f40/users/8ec6096d799746b782298657b2fab198/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:15.817395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb5961-85c0-48ac-860f-ef2876eb1bf4 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.818167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb5961-85c0-48ac-860f-ef2876eb1bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.818167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb5961-85c0-48ac-860f-ef2876eb1bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.847361 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-20cb5961-85c0-48ac-860f-ef2876eb1bf4 None None] MFA Rules not processed for user `8ec6096d799746b782298657b2fab198`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:15.848665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-20cb5961-85c0-48ac-860f-ef2876eb1bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:15.863974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03694c76-5035-4563-a7c1-2c622422c5e4 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:15.865755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-03694c76-5035-4563-a7c1-2c622422c5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:15.870236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:15.945921 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1371/2719] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:15.957113 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb5961-85c0-48ac-860f-ef2876eb1bf4 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:15.958492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-20cb5961-85c0-48ac-860f-ef2876eb1bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:15.966870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03694c76-5035-4563-a7c1-2c622422c5e4 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:15.976017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:15.976017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:15.976017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:15.976017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] PATH_INFO: `/v3/projects/3c48a0b11a2d42fab313b685352f5045` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:15.978437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c48a0b11a2d42fab313b685352f5045)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:15.978437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:16.001458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:16.022058 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb5961-85c0-48ac-860f-ef2876eb1bf4 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:16.025731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d52e52-f3fc-4d43-ba0d-7b0c88ef0ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:16.026334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d52e52-f3fc-4d43-ba0d-7b0c88ef0ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:16.027147 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d52e52-f3fc-4d43-ba0d-7b0c88ef0ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:16.027447 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d52e52-f3fc-4d43-ba0d-7b0c88ef0ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:16.083489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d52e52-f3fc-4d43-ba0d-7b0c88ef0ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:16.085071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d52e52-f3fc-4d43-ba0d-7b0c88ef0ef9 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:16.091339 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c48a0b11a2d42fab313b685352f5045', 'request_id': 'req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.094624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1372/2720] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:16.095432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d52e52-f3fc-4d43-ba0d-7b0c88ef0ef9 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:16.096794 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-70d52e52-f3fc-4d43-ba0d-7b0c88ef0ef9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:16.098524 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c48a0b11a2d42fab313b685352f5045', 'request_id': 'req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.155467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d52e52-f3fc-4d43-ba0d-7b0c88ef0ef9 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:16.186961 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c48a0b11a2d42fab313b685352f5045', 'request_id': 'req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.200084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] The token cache is being invalidate because project 3c48a0b11a2d42fab313b685352f5045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:16.200376 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.201066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.202841 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1349/2721] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:15 2022] DELETE /identity/v3/projects/3c48a0b11a2d42fab313b685352f5045 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:16.208366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:16.216440 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:16.217520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88683f57-e7ea-4dea-88fb-bf6b747d4973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:16.218822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88683f57-e7ea-4dea-88fb-bf6b747d4973 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:16.218822 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88683f57-e7ea-4dea-88fb-bf6b747d4973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:16.219025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88683f57-e7ea-4dea-88fb-bf6b747d4973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:16.220944 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-88683f57-e7ea-4dea-88fb-bf6b747d4973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:16.221893 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:16.304273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a945d-5bf9-4a1e-87b4-1b65dddc0f24 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:16.304480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88683f57-e7ea-4dea-88fb-bf6b747d4973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:16.305714 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88683f57-e7ea-4dea-88fb-bf6b747d4973 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:16.309860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:16.310677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:16.310891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:16.311221 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] PATH_INFO: `/v3/users/8025f7541b834858a8893dc572dce8eb` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:16.312318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8025f7541b834858a8893dc572dce8eb)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:16.314302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:16.316809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1373/2722] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:16.583490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8025f7541b834858a8893dc572dce8eb'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.666805 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8025f7541b834858a8893dc572dce8eb'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.681711 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8025f7541b834858a8893dc572dce8eb'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.682432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8025f7541b834858a8893dc572dce8eb'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.690835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8025f7541b834858a8893dc572dce8eb'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:16.698454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1350/2723] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:16 2022] DELETE /identity/v3/users/8025f7541b834858a8893dc572dce8eb => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:17.215499 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88683f57-e7ea-4dea-88fb-bf6b747d4973 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:17.227051 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88683f57-e7ea-4dea-88fb-bf6b747d4973 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:17.297812 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:17.298465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:17.298750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:17.299053 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] PATH_INFO: `/v3/projects/8f505e9c71b14f85af92e5dcc541ea6c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:17.300349 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f505e9c71b14f85af92e5dcc541ea6c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:17.302452 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:17.427431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f505e9c71b14f85af92e5dcc541ea6c', 'request_id': 'req-021e51af-14e4-4493-94c5-27ef4f51be20'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:17.569646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f505e9c71b14f85af92e5dcc541ea6c', 'request_id': 'req-021e51af-14e4-4493-94c5-27ef4f51be20'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:17.576969 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f505e9c71b14f85af92e5dcc541ea6c', 'request_id': 'req-021e51af-14e4-4493-94c5-27ef4f51be20'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:17.592097 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] The token cache is being invalidate because project 8f505e9c71b14f85af92e5dcc541ea6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:17.592673 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:17.593501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:17.595667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1374/2724] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:17 2022] DELETE /identity/v3/projects/8f505e9c71b14f85af92e5dcc541ea6c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:17.600105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:17.602427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:17.617922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d125-1870-49be-a367-8863d75f87b8 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:17.644589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:17.677937 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:17.678575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:17.678859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:17.679134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] PATH_INFO: `/v3/users/207246c45c5c4eb4b23409d29b2327ab` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:17.680306 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=207246c45c5c4eb4b23409d29b2327ab)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:17.682215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:17.962038 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207246c45c5c4eb4b23409d29b2327ab'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:18.050281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207246c45c5c4eb4b23409d29b2327ab'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:18.068293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207246c45c5c4eb4b23409d29b2327ab'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:18.069799 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207246c45c5c4eb4b23409d29b2327ab'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:18.092591 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207246c45c5c4eb4b23409d29b2327ab'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:18.099432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1351/2725] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:17 2022] DELETE /identity/v3/users/207246c45c5c4eb4b23409d29b2327ab => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:18.657932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:18.659576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:18.671096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:18.676751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e51af-14e4-4493-94c5-27ef4f51be20 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:18.782305 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:18.782967 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:18.783257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:18.783548 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] PATH_INFO: `/v3/projects/1104b2ef04844bd48ee070c17dfaf6bb` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:18.784926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1104b2ef04844bd48ee070c17dfaf6bb)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:18.787926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:19.016213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1104b2ef04844bd48ee070c17dfaf6bb', 'request_id': 'req-912eb4c8-41d5-45c2-850c-3f92f50cfb16'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.105937 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1104b2ef04844bd48ee070c17dfaf6bb', 'request_id': 'req-912eb4c8-41d5-45c2-850c-3f92f50cfb16'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.117197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1104b2ef04844bd48ee070c17dfaf6bb', 'request_id': 'req-912eb4c8-41d5-45c2-850c-3f92f50cfb16'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.128788 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] The token cache is being invalidate because project 1104b2ef04844bd48ee070c17dfaf6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:19.129075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.129734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-912eb4c8-41d5-45c2-850c-3f92f50cfb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.131228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1375/2726] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:18 2022] DELETE /identity/v3/projects/1104b2ef04844bd48ee070c17dfaf6bb => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:19.411486 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:19.413340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:19.428702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c34f99-b3b6-4e04-b986-43a5c8ae5cc9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:19.522375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:19.522375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:19.522375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:19.522375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] PATH_INFO: `/v3/users/0b246677d943427e8a6221d8c31d0a90` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:19.524189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b246677d943427e8a6221d8c31d0a90)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:19.527868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:19.735951 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b246677d943427e8a6221d8c31d0a90'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.741111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:19.822294 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b246677d943427e8a6221d8c31d0a90'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.847681 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b246677d943427e8a6221d8c31d0a90'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.849345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b246677d943427e8a6221d8c31d0a90'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.867118 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b246677d943427e8a6221d8c31d0a90'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:19.879585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1352/2727] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:19 2022] DELETE /identity/v3/users/0b246677d943427e8a6221d8c31d0a90 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:19.881907 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6aae1-e2b7-4fa2-b1c8-2b4e8d632946 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:19.882395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6aae1-e2b7-4fa2-b1c8-2b4e8d632946 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:19.882481 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6aae1-e2b7-4fa2-b1c8-2b4e8d632946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:19.916327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-dbe6aae1-e2b7-4fa2-b1c8-2b4e8d632946 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:19.918327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-dbe6aae1-e2b7-4fa2-b1c8-2b4e8d632946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:20.003480 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1376/2728] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:20.010160 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:20.012167 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:20.070789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e18fc-c74c-4e40-966b-b96d38557d26 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:20.075103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c82ac-62ab-4c62-85dd-5648bf952136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:20.075754 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c82ac-62ab-4c62-85dd-5648bf952136 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:20.076040 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c82ac-62ab-4c62-85dd-5648bf952136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:20.076314 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c82ac-62ab-4c62-85dd-5648bf952136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:20.086430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c82ac-62ab-4c62-85dd-5648bf952136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:20.087925 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c82ac-62ab-4c62-85dd-5648bf952136 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:20.098574 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1353/2729] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:20.125057 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c0b22-0696-41c7-9397-348a27d2a0f9 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:20.125343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c0b22-0696-41c7-9397-348a27d2a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:20.125616 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c0b22-0696-41c7-9397-348a27d2a0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:20.145777 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-d70c0b22-0696-41c7-9397-348a27d2a0f9 None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:20.146990 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d70c0b22-0696-41c7-9397-348a27d2a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:20.181078 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:20.209912 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1377/2730] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:25:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:20.236653 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c82ac-62ab-4c62-85dd-5648bf952136 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:20.238495 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-666c82ac-62ab-4c62-85dd-5648bf952136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:20.397231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c82ac-62ab-4c62-85dd-5648bf952136 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:20.408046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404c719-9728-47b2-9b6e-2536c8535c14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:20.409394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c719-9728-47b2-9b6e-2536c8535c14 service swift] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:20.409683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c719-9728-47b2-9b6e-2536c8535c14 service swift] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:20.409959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c719-9728-47b2-9b6e-2536c8535c14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:20.423419 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404c719-9728-47b2-9b6e-2536c8535c14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:20.425178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404c719-9728-47b2-9b6e-2536c8535c14 service swift] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:20.434479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1354/2731] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:25:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:25:20.597064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c0b22-0696-41c7-9397-348a27d2a0f9 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:20.597377 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d70c0b22-0696-41c7-9397-348a27d2a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:20.623979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c0b22-0696-41c7-9397-348a27d2a0f9 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:20.630482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:20.631404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:20.631866 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:20.632277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] PATH_INFO: `/v3/projects/a08a9325f35243d082e9135eabf44f8e` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:20.634039 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08a9325f35243d082e9135eabf44f8e)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:20.638957 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:20.760546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08a9325f35243d082e9135eabf44f8e', 'request_id': 'req-10d29c62-f35d-422d-94f9-ba70f44b27bd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:20.885710 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08a9325f35243d082e9135eabf44f8e', 'request_id': 'req-10d29c62-f35d-422d-94f9-ba70f44b27bd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:20.893656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08a9325f35243d082e9135eabf44f8e', 'request_id': 'req-10d29c62-f35d-422d-94f9-ba70f44b27bd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:20.918663 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] The token cache is being invalidate because project a08a9325f35243d082e9135eabf44f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:20.919026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:20.919793 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-10d29c62-f35d-422d-94f9-ba70f44b27bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:20.921284 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1378/2732] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:20 2022] DELETE /identity/v3/projects/a08a9325f35243d082e9135eabf44f8e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:20.926251 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404c719-9728-47b2-9b6e-2536c8535c14 service swift] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:20.939239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404c719-9728-47b2-9b6e-2536c8535c14 service swift] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:21.023361 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:21.030046 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:21.030850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:21.031130 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:21.031402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] PATH_INFO: `/v3/users/8ec6096d799746b782298657b2fab198` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:21.032583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec6096d799746b782298657b2fab198)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:21.034510 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:21.244217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec6096d799746b782298657b2fab198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:21.307838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec6096d799746b782298657b2fab198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:21.327284 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec6096d799746b782298657b2fab198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:21.328330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec6096d799746b782298657b2fab198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:21.337002 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec6096d799746b782298657b2fab198'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:21.348548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1355/2733] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:20 2022] DELETE /identity/v3/users/8ec6096d799746b782298657b2fab198 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:21.548518 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4e31-26c2-4ccd-81e4-ef954515771c None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:21.548890 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4e31-26c2-4ccd-81e4-ef954515771c None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:21.549089 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4e31-26c2-4ccd-81e4-ef954515771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:21.573406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-acdf4e31-26c2-4ccd-81e4-ef954515771c None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:21.573406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-acdf4e31-26c2-4ccd-81e4-ef954515771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:21.665271 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1379/2734] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:21.666368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:21.669980 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:21.771013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624da91-a5b8-4991-8821-ae8271fb5962 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:21.776068 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de47e1-f0fc-492e-b2fe-81baa26c637c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:21.776740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de47e1-f0fc-492e-b2fe-81baa26c637c service swift] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:21.777021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de47e1-f0fc-492e-b2fe-81baa26c637c service swift] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:21.777291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de47e1-f0fc-492e-b2fe-81baa26c637c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:21.786071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de47e1-f0fc-492e-b2fe-81baa26c637c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:21.787752 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de47e1-f0fc-492e-b2fe-81baa26c637c service swift] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:21.796922 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1356/2735] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:25:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:25:21.872750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4e31-26c2-4ccd-81e4-ef954515771c None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:21.872750 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-acdf4e31-26c2-4ccd-81e4-ef954515771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:21.948204 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4e31-26c2-4ccd-81e4-ef954515771c None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:21.953359 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:21.953996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:21.954283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:21.955229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] PATH_INFO: `/v3/projects/bc7c7e3a1f2f4020be5fcacd15180f40` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:21.956697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7c7e3a1f2f4020be5fcacd15180f40)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:21.958869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:21.973047 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:22.070297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7c7e3a1f2f4020be5fcacd15180f40', 'request_id': 'req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:22.137615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7c7e3a1f2f4020be5fcacd15180f40', 'request_id': 'req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:22.146832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7c7e3a1f2f4020be5fcacd15180f40', 'request_id': 'req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:22.162474 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] The token cache is being invalidate because project bc7c7e3a1f2f4020be5fcacd15180f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:22.163048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:22.164070 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d7fe2b55-ab99-431e-be54-c6e0b916f7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:22.165918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1380/2736] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:21 2022] DELETE /identity/v3/projects/bc7c7e3a1f2f4020be5fcacd15180f40 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:22.171372 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18258d-a68d-4848-bc98-24980b45482d None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.171825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18258d-a68d-4848-bc98-24980b45482d None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.172011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18258d-a68d-4848-bc98-24980b45482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.197069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-9f18258d-a68d-4848-bc98-24980b45482d None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:22.200989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9f18258d-a68d-4848-bc98-24980b45482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:22.279813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1357/2737] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:22.281648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335f2fb-99fd-4214-9ddd-a51e7d58c56e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.282000 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335f2fb-99fd-4214-9ddd-a51e7d58c56e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.282344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335f2fb-99fd-4214-9ddd-a51e7d58c56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.304486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9335f2fb-99fd-4214-9ddd-a51e7d58c56e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:22.305718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9335f2fb-99fd-4214-9ddd-a51e7d58c56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:22.314346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1381/2738] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:22.318887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18258d-a68d-4848-bc98-24980b45482d None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:22.330107 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18258d-a68d-4848-bc98-24980b45482d None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:22.335605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bb7e8-a2a2-44c3-965f-ff799d251d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:22.336270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bb7e8-a2a2-44c3-965f-ff799d251d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.336609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bb7e8-a2a2-44c3-965f-ff799d251d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.336890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bb7e8-a2a2-44c3-965f-ff799d251d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.337556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bb7e8-a2a2-44c3-965f-ff799d251d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:25:22.337864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bb7e8-a2a2-44c3-965f-ff799d251d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:22.340100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bb7e8-a2a2-44c3-965f-ff799d251d10 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:22.341869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:22.366013 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1358/2739] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:25:22.369158 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335f2fb-99fd-4214-9ddd-a51e7d58c56e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:22.379095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335f2fb-99fd-4214-9ddd-a51e7d58c56e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:22.385435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a190e5-da21-4265-be21-90d38b2c09e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:22.387237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a190e5-da21-4265-be21-90d38b2c09e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.387237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a190e5-da21-4265-be21-90d38b2c09e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.387237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a190e5-da21-4265-be21-90d38b2c09e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.389244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a190e5-da21-4265-be21-90d38b2c09e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:22.390325 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a190e5-da21-4265-be21-90d38b2c09e9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:22.485018 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1382/2740] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:22 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:22.489777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bb7e8-a2a2-44c3-965f-ff799d251d10 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:22.505009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bb7e8-a2a2-44c3-965f-ff799d251d10 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:22.514337 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba55c4a-6816-4784-b137-2eb7b5807cc9 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.514604 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba55c4a-6816-4784-b137-2eb7b5807cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.514888 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba55c4a-6816-4784-b137-2eb7b5807cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.536557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8ba55c4a-6816-4784-b137-2eb7b5807cc9 None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:22.537795 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8ba55c4a-6816-4784-b137-2eb7b5807cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:22.570335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce3975-3b52-48c6-a206-b45a22428854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:22.570950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3975-3b52-48c6-a206-b45a22428854 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.571239 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3975-3b52-48c6-a206-b45a22428854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.571516 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3975-3b52-48c6-a206-b45a22428854 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.572205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce3975-3b52-48c6-a206-b45a22428854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:22.574350 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce3975-3b52-48c6-a206-b45a22428854 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:22.600971 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1383/2741] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:22.617250 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba55c4a-6816-4784-b137-2eb7b5807cc9 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:22.618914 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8ba55c4a-6816-4784-b137-2eb7b5807cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:22.655318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1359/2742] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:22 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:22.660032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce3975-3b52-48c6-a206-b45a22428854 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:22.674644 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce3975-3b52-48c6-a206-b45a22428854 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:22.685757 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126206cc-110e-40c7-83a4-1b15380ced46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:22.686560 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126206cc-110e-40c7-83a4-1b15380ced46 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.686849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126206cc-110e-40c7-83a4-1b15380ced46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.687128 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126206cc-110e-40c7-83a4-1b15380ced46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.687874 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126206cc-110e-40c7-83a4-1b15380ced46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:22.690794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126206cc-110e-40c7-83a4-1b15380ced46 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:22.717769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1360/2743] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:22.718782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126206cc-110e-40c7-83a4-1b15380ced46 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:22.733959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126206cc-110e-40c7-83a4-1b15380ced46 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:22.742517 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cfdf8-3572-4b6b-9590-d65c29b4b4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:22.743140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cfdf8-3572-4b6b-9590-d65c29b4b4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.746074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cfdf8-3572-4b6b-9590-d65c29b4b4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.746074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cfdf8-3572-4b6b-9590-d65c29b4b4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.746074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cfdf8-3572-4b6b-9590-d65c29b4b4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:22.746848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cfdf8-3572-4b6b-9590-d65c29b4b4d2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:22.763679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1361/2744] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:22.770237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cfdf8-3572-4b6b-9590-d65c29b4b4d2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:22.781196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba55c4a-6816-4784-b137-2eb7b5807cc9 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:22.782442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cfdf8-3572-4b6b-9590-d65c29b4b4d2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:22.788948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6783c-4594-4b3b-9bfb-707a98d78f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:22.790084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6783c-4594-4b3b-9bfb-707a98d78f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.790580 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6783c-4594-4b3b-9bfb-707a98d78f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.791081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6783c-4594-4b3b-9bfb-707a98d78f46 admin admin] PATH_INFO: `/v3/projects/42719a72e4014c64b43874f9402f11f3/users/2224f2359a5a42e881d9651342c95c7b/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.795260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5d966-5d35-4032-985e-66fdb651f033 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:22.796519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5d966-5d35-4032-985e-66fdb651f033 service swift] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.797046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5d966-5d35-4032-985e-66fdb651f033 service swift] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.797894 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5d966-5d35-4032-985e-66fdb651f033 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.817010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5d966-5d35-4032-985e-66fdb651f033 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:22.820582 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6783c-4594-4b3b-9bfb-707a98d78f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42719a72e4014c64b43874f9402f11f3, user_id=2224f2359a5a42e881d9651342c95c7b, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:22.820884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6783c-4594-4b3b-9bfb-707a98d78f46 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:22.821372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5d966-5d35-4032-985e-66fdb651f033 service swift] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:22.840196 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1384/2745] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:25:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:25:22.879493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1362/2746] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:22 2022] PUT /identity/v3/projects/42719a72e4014c64b43874f9402f11f3/users/2224f2359a5a42e881d9651342c95c7b/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:22.891077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e558ff7-f0bc-4fda-bf17-3aa62af5125a None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:22.891077 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e558ff7-f0bc-4fda-bf17-3aa62af5125a None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:22.891327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e558ff7-f0bc-4fda-bf17-3aa62af5125a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:22.899296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:22.921267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-3e558ff7-f0bc-4fda-bf17-3aa62af5125a None None] MFA Rules not processed for user `2224f2359a5a42e881d9651342c95c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:22.922644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-3e558ff7-f0bc-4fda-bf17-3aa62af5125a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:23.016020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1385/2747] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:23.029170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6783c-4594-4b3b-9bfb-707a98d78f46 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:23.031258 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cea6783c-4594-4b3b-9bfb-707a98d78f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:23.105875 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6783c-4594-4b3b-9bfb-707a98d78f46 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:23.110016 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aea73a-4081-4ced-995c-26944405dee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:23.122522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aea73a-4081-4ced-995c-26944405dee5 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:23.122958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aea73a-4081-4ced-995c-26944405dee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:23.123341 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aea73a-4081-4ced-995c-26944405dee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:23.134504 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aea73a-4081-4ced-995c-26944405dee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:23.136786 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aea73a-4081-4ced-995c-26944405dee5 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:23.147081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1363/2748] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:23.530820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48fb5-943f-4321-9055-8f681997d79e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:23.531101 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48fb5-943f-4321-9055-8f681997d79e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:23.531381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48fb5-943f-4321-9055-8f681997d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:23.552577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-36e48fb5-943f-4321-9055-8f681997d79e None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:23.554509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-36e48fb5-943f-4321-9055-8f681997d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:23.612857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1386/2749] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:23.626443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aea73a-4081-4ced-995c-26944405dee5 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:23.671847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:23.700715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aea73a-4081-4ced-995c-26944405dee5 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:23.705677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6baa13-d5cc-42f9-8e9f-468127408e0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:23.706536 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6baa13-d5cc-42f9-8e9f-468127408e0f service swift] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:23.706810 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6baa13-d5cc-42f9-8e9f-468127408e0f service swift] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:23.707076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6baa13-d5cc-42f9-8e9f-468127408e0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:23.717288 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6baa13-d5cc-42f9-8e9f-468127408e0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:23.718748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6baa13-d5cc-42f9-8e9f-468127408e0f service swift] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:23.727411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1364/2750] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:25:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:25:25.046988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e48fb5-943f-4321-9055-8f681997d79e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:25.048558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-36e48fb5-943f-4321-9055-8f681997d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:25.133539 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e48fb5-943f-4321-9055-8f681997d79e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:25.139167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:25.139916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:25.140229 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:25.140507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] PATH_INFO: `/v3/users/154bb32329e3414aa19b681a23af735c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:25.141662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154bb32329e3414aa19b681a23af735c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:25.143572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:25.295177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:25.302255 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154bb32329e3414aa19b681a23af735c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:25.302947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154bb32329e3414aa19b681a23af735c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:25.421577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154bb32329e3414aa19b681a23af735c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:25.422283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154bb32329e3414aa19b681a23af735c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:25.437965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154bb32329e3414aa19b681a23af735c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:25.463843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1387/2751] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:25 2022] DELETE /identity/v3/users/154bb32329e3414aa19b681a23af735c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:25.768223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6baa13-d5cc-42f9-8e9f-468127408e0f service swift] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:25.783268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6baa13-d5cc-42f9-8e9f-468127408e0f service swift] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:25.844673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:25.845335 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:25.845620 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:25.845890 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] PATH_INFO: `/v3/projects/d056389d57f84cb490befe4de1f9b067` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:25.847003 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d056389d57f84cb490befe4de1f9b067)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:25.848944 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:25.989563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd056389d57f84cb490befe4de1f9b067', 'request_id': 'req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:25.996986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd056389d57f84cb490befe4de1f9b067', 'request_id': 'req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.078587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd056389d57f84cb490befe4de1f9b067', 'request_id': 'req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.090264 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] The token cache is being invalidate because project d056389d57f84cb490befe4de1f9b067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:26.090557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.091344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.093009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1365/2752] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:25 2022] DELETE /identity/v3/projects/d056389d57f84cb490befe4de1f9b067 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:26.097072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:26.098472 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:26.115993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fd814-626e-42a4-8323-6f0b043933f8 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:26.170130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:26.170764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:26.171048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:26.171324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] PATH_INFO: `/v3/users/c041d33eac8a4abbac21b972ecc017ee` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:26.172491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c041d33eac8a4abbac21b972ecc017ee)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:26.174543 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:26.356541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c041d33eac8a4abbac21b972ecc017ee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.357259 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c041d33eac8a4abbac21b972ecc017ee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.449796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c041d33eac8a4abbac21b972ecc017ee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.450437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c041d33eac8a4abbac21b972ecc017ee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.461579 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c041d33eac8a4abbac21b972ecc017ee'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.477775 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1388/2753] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:26 2022] DELETE /identity/v3/users/c041d33eac8a4abbac21b972ecc017ee => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:26.686081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:26.687545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:26.701605 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa15bf-0bf5-4c62-ac30-2150978f77f9 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:26.767342 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:26.768019 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:26.768302 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:26.768849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] PATH_INFO: `/v3/projects/ca360b8865404e2199c3c78504381c32` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:26.769673 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca360b8865404e2199c3c78504381c32)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:26.771554 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:26.773101 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:26.879261 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca360b8865404e2199c3c78504381c32', 'request_id': 'req-e35d932b-4f51-4967-b487-a668f672ef2e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.885642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca360b8865404e2199c3c78504381c32', 'request_id': 'req-e35d932b-4f51-4967-b487-a668f672ef2e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.981695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:26.985181 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca360b8865404e2199c3c78504381c32', 'request_id': 'req-e35d932b-4f51-4967-b487-a668f672ef2e'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.985330 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:26.996270 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] The token cache is being invalidate because project ca360b8865404e2199c3c78504381c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:26.996655 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.997225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-e35d932b-4f51-4967-b487-a668f672ef2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:26.999080 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1366/2754] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:26 2022] DELETE /identity/v3/projects/ca360b8865404e2199c3c78504381c32 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:26.999868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295599a1-0b9c-4b5b-89eb-b5d6a341ce44 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:27.053585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:27.083585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:27.084586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:27.085100 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:27.085824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] PATH_INFO: `/v3/users/8c635a31617d406dab0c85da603f7dd5` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:27.087303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c635a31617d406dab0c85da603f7dd5)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:27.089947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:27.264552 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c635a31617d406dab0c85da603f7dd5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.265200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c635a31617d406dab0c85da603f7dd5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.322558 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c635a31617d406dab0c85da603f7dd5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.323173 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c635a31617d406dab0c85da603f7dd5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.331798 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c635a31617d406dab0c85da603f7dd5'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.350110 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1389/2755] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:26 2022] DELETE /identity/v3/users/8c635a31617d406dab0c85da603f7dd5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:27.355427 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e726fc-df5b-4be0-b551-286cecc66313 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:27.355755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e726fc-df5b-4be0-b551-286cecc66313 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:27.356030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e726fc-df5b-4be0-b551-286cecc66313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:27.375119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-60e726fc-df5b-4be0-b551-286cecc66313 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:27.376857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-60e726fc-df5b-4be0-b551-286cecc66313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:27.449507 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1367/2756] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:27.459290 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:27.460821 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:27.461817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e726fc-df5b-4be0-b551-286cecc66313 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:27.463229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-60e726fc-df5b-4be0-b551-286cecc66313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:27.475859 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e726fc-df5b-4be0-b551-286cecc66313 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:27.481097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:27.481734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:27.482018 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:27.482291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] PATH_INFO: `/v3/users/2224f2359a5a42e881d9651342c95c7b` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:27.483414 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2224f2359a5a42e881d9651342c95c7b)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:27.485363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:27.519679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa35ca-0fff-49dc-a20f-970cfe85f85e admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:27.523257 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fd08b-8bba-45a1-8ee7-01c97bc87bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:27.523893 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fd08b-8bba-45a1-8ee7-01c97bc87bcc service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:27.524172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fd08b-8bba-45a1-8ee7-01c97bc87bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:27.524448 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fd08b-8bba-45a1-8ee7-01c97bc87bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:27.534146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fd08b-8bba-45a1-8ee7-01c97bc87bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:27.535554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fd08b-8bba-45a1-8ee7-01c97bc87bcc service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:27.544984 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1390/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:27.647878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2224f2359a5a42e881d9651342c95c7b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.689988 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2224f2359a5a42e881d9651342c95c7b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.702834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2224f2359a5a42e881d9651342c95c7b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.703533 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2224f2359a5a42e881d9651342c95c7b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.710857 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2224f2359a5a42e881d9651342c95c7b'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:27.717982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1368/2758] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:27 2022] DELETE /identity/v3/users/2224f2359a5a42e881d9651342c95c7b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:27.724656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af972-3eb3-4b69-a5f5-149bd51e31e9 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:27.724656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af972-3eb3-4b69-a5f5-149bd51e31e9 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:27.724656 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af972-3eb3-4b69-a5f5-149bd51e31e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:27.750883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-0c0af972-3eb3-4b69-a5f5-149bd51e31e9 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:27.752136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0c0af972-3eb3-4b69-a5f5-149bd51e31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:27.802703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:27.814237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1391/2759] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:27.814401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:27.814401 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:27.822375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:27.825394 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af972-3eb3-4b69-a5f5-149bd51e31e9 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:27.826820 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-0c0af972-3eb3-4b69-a5f5-149bd51e31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:27.829385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d7b4-820b-4a9d-946c-d4a5ee4d8c2d admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:27.845529 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:27.846079 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:27.846521 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:27.846812 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] PATH_INFO: `/v3/projects/923440081cdc45d58b408280170942c3` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:27.848268 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923440081cdc45d58b408280170942c3)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:27.850737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:27.886525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af972-3eb3-4b69-a5f5-149bd51e31e9 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:27.890283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fd643-2f08-456b-8635-ee1abea7139e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:27.890898 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fd643-2f08-456b-8635-ee1abea7139e service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:27.891181 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fd643-2f08-456b-8635-ee1abea7139e service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:27.891458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fd643-2f08-456b-8635-ee1abea7139e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:27.900698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fd643-2f08-456b-8635-ee1abea7139e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:27.902103 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fd643-2f08-456b-8635-ee1abea7139e service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:27.912339 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1392/2760] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:25:27.994052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923440081cdc45d58b408280170942c3', 'request_id': 'req-fc8b224c-459a-4aa0-bfce-7437d4ac4268'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.001030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923440081cdc45d58b408280170942c3', 'request_id': 'req-fc8b224c-459a-4aa0-bfce-7437d4ac4268'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.084074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923440081cdc45d58b408280170942c3', 'request_id': 'req-fc8b224c-459a-4aa0-bfce-7437d4ac4268'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.095074 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] The token cache is being invalidate because project 923440081cdc45d58b408280170942c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:28.095368 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.096071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fc8b224c-459a-4aa0-bfce-7437d4ac4268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.097823 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1369/2761] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:27 2022] DELETE /identity/v3/projects/923440081cdc45d58b408280170942c3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:28.102661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec7ac5-190e-4fbc-9d27-17940593163e None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.102996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec7ac5-190e-4fbc-9d27-17940593163e None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.103252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec7ac5-190e-4fbc-9d27-17940593163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.124538 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-9bec7ac5-190e-4fbc-9d27-17940593163e None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:28.125745 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9bec7ac5-190e-4fbc-9d27-17940593163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:28.190576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1393/2762] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:28.199445 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f957f6-fe2f-4978-8ae1-4f6c9cb8ca26 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.200800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f957f6-fe2f-4978-8ae1-4f6c9cb8ca26 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.201103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f957f6-fe2f-4978-8ae1-4f6c9cb8ca26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.222927 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-61f957f6-fe2f-4978-8ae1-4f6c9cb8ca26 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:28.224214 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-61f957f6-fe2f-4978-8ae1-4f6c9cb8ca26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:28.234671 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1370/2763] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:28.237644 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec7ac5-190e-4fbc-9d27-17940593163e None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:28.248127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec7ac5-190e-4fbc-9d27-17940593163e None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:28.252768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:28.253403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.253689 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.254049 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.254620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:25:28.254935 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:28.256583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:28.269042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1394/2764] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 12:25:28.273563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f957f6-fe2f-4978-8ae1-4f6c9cb8ca26 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:28.284200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f957f6-fe2f-4978-8ae1-4f6c9cb8ca26 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:28.288926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712a068-aa5e-44bd-b5b3-4100c81ed84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:28.289519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712a068-aa5e-44bd-b5b3-4100c81ed84a admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.289796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712a068-aa5e-44bd-b5b3-4100c81ed84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.290066 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712a068-aa5e-44bd-b5b3-4100c81ed84a admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.290726 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712a068-aa5e-44bd-b5b3-4100c81ed84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:28.292632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712a068-aa5e-44bd-b5b3-4100c81ed84a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:28.308526 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:28.310853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:28.325763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c9b70-0b9e-485b-a799-23a00108a4f3 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:28.330496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:28.331979 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.332327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.332791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] PATH_INFO: `/v3/projects/42719a72e4014c64b43874f9402f11f3` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.334004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42719a72e4014c64b43874f9402f11f3)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:28.335873 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:28.400345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1371/2765] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:28 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:28.405109 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712a068-aa5e-44bd-b5b3-4100c81ed84a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:28.476611 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712a068-aa5e-44bd-b5b3-4100c81ed84a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:28.481404 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd7a20-1e31-4656-8055-7201605811f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:28.482022 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd7a20-1e31-4656-8055-7201605811f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.482359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd7a20-1e31-4656-8055-7201605811f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.482638 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd7a20-1e31-4656-8055-7201605811f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.483301 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd7a20-1e31-4656-8055-7201605811f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:28.485291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd7a20-1e31-4656-8055-7201605811f1 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:28.503064 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42719a72e4014c64b43874f9402f11f3', 'request_id': 'req-a7873529-61ba-48c1-bb83-9963145dac6c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.576081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1372/2766] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:28 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:25:28.580112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd7a20-1e31-4656-8055-7201605811f1 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:28.591030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd7a20-1e31-4656-8055-7201605811f1 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:28.591733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42719a72e4014c64b43874f9402f11f3', 'request_id': 'req-a7873529-61ba-48c1-bb83-9963145dac6c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.599496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42719a72e4014c64b43874f9402f11f3', 'request_id': 'req-a7873529-61ba-48c1-bb83-9963145dac6c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.614836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] The token cache is being invalidate because project 42719a72e4014c64b43874f9402f11f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:28.615467 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.616206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:28.617770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1395/2767] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:28 2022] DELETE /identity/v3/projects/42719a72e4014c64b43874f9402f11f3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:28.640479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:28.654609 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d28142-fee5-43c3-b593-c7cce7e79be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:28.655244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d28142-fee5-43c3-b593-c7cce7e79be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.655525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d28142-fee5-43c3-b593-c7cce7e79be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.655838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d28142-fee5-43c3-b593-c7cce7e79be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.656510 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d28142-fee5-43c3-b593-c7cce7e79be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:28.658170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d28142-fee5-43c3-b593-c7cce7e79be5 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:28.670054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1373/2768] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 12:25:28.676949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:28.678556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:28.692319 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7873529-61ba-48c1-bb83-9963145dac6c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:28.697507 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb49b3-4955-4e8b-928a-0a09ff0aebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:28.698034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb49b3-4955-4e8b-928a-0a09ff0aebe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.698312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb49b3-4955-4e8b-928a-0a09ff0aebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.698587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb49b3-4955-4e8b-928a-0a09ff0aebe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.699247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb49b3-4955-4e8b-928a-0a09ff0aebe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:28.700903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb49b3-4955-4e8b-928a-0a09ff0aebe7 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:28.715840 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1396/2769] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:28.718259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d28142-fee5-43c3-b593-c7cce7e79be5 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:28.730052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d28142-fee5-43c3-b593-c7cce7e79be5 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:28.735880 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993d9af-5d50-4f83-bd7b-fc785372ec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:28.736728 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993d9af-5d50-4f83-bd7b-fc785372ec5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.737205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993d9af-5d50-4f83-bd7b-fc785372ec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.737991 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993d9af-5d50-4f83-bd7b-fc785372ec5d admin admin] PATH_INFO: `/v3/projects/1717f903a6424ebe9d78cc62e4c64d71/users/25a397e3b5ba45e9af4efdd33ccc8963/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.754096 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993d9af-5d50-4f83-bd7b-fc785372ec5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1717f903a6424ebe9d78cc62e4c64d71, user_id=25a397e3b5ba45e9af4efdd33ccc8963, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:28.756863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993d9af-5d50-4f83-bd7b-fc785372ec5d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:28.839733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1374/2770] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:28 2022] PUT /identity/v3/projects/1717f903a6424ebe9d78cc62e4c64d71/users/25a397e3b5ba45e9af4efdd33ccc8963/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:28.845765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfdab0-7cf6-4674-af6d-e5662ba71f71 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:28.846002 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfdab0-7cf6-4674-af6d-e5662ba71f71 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:28.846422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfdab0-7cf6-4674-af6d-e5662ba71f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:28.854423 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:28.868245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-61dfdab0-7cf6-4674-af6d-e5662ba71f71 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:28.869465 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-61dfdab0-7cf6-4674-af6d-e5662ba71f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:28.929082 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1397/2771] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:28.939428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993d9af-5d50-4f83-bd7b-fc785372ec5d admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:28.941176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-a993d9af-5d50-4f83-bd7b-fc785372ec5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:28.999577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993d9af-5d50-4f83-bd7b-fc785372ec5d admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:29.003490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fd95a-7743-49c8-abf0-e461e1323f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:29.004129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fd95a-7743-49c8-abf0-e461e1323f89 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:29.004410 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fd95a-7743-49c8-abf0-e461e1323f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:29.004683 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fd95a-7743-49c8-abf0-e461e1323f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:29.014612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fd95a-7743-49c8-abf0-e461e1323f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:29.016072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fd95a-7743-49c8-abf0-e461e1323f89 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:29.025557 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1375/2772] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:34.568959 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3901e5-af9f-473f-8fb9-e1be724bbb39 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:34.570026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3901e5-af9f-473f-8fb9-e1be724bbb39 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:34.570475 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3901e5-af9f-473f-8fb9-e1be724bbb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:34.605456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-5e3901e5-af9f-473f-8fb9-e1be724bbb39 None None] MFA Rules not processed for user `25a397e3b5ba45e9af4efdd33ccc8963`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:34.607460 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5e3901e5-af9f-473f-8fb9-e1be724bbb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:34.680149 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1398/2773] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:34.684964 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fd95a-7743-49c8-abf0-e461e1323f89 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:34.695134 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fd95a-7743-49c8-abf0-e461e1323f89 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:34.699962 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e31685-0f0c-4ec9-83f9-e40367e4c3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:34.700577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e31685-0f0c-4ec9-83f9-e40367e4c3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:34.700860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e31685-0f0c-4ec9-83f9-e40367e4c3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:34.701140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e31685-0f0c-4ec9-83f9-e40367e4c3e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:34.701777 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e31685-0f0c-4ec9-83f9-e40367e4c3e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:34.703887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e31685-0f0c-4ec9-83f9-e40367e4c3e8 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:34.818316 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1376/2774] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:34 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:34.824715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3901e5-af9f-473f-8fb9-e1be724bbb39 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:34.835270 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3901e5-af9f-473f-8fb9-e1be724bbb39 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:34.896362 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bde6e-7ce7-4a2d-a457-5c5e454104ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:34.896996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bde6e-7ce7-4a2d-a457-5c5e454104ee admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:34.897278 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bde6e-7ce7-4a2d-a457-5c5e454104ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:34.897556 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bde6e-7ce7-4a2d-a457-5c5e454104ee admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:34.898205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bde6e-7ce7-4a2d-a457-5c5e454104ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:34.900200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bde6e-7ce7-4a2d-a457-5c5e454104ee admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:34.976618 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1399/2775] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:34 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:34.985178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e31685-0f0c-4ec9-83f9-e40367e4c3e8 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:34.992388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e31685-0f0c-4ec9-83f9-e40367e4c3e8 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:34.998081 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650c0c1-623b-4f6e-820a-75af58d0ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:34.998706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650c0c1-623b-4f6e-820a-75af58d0ea35 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:34.999158 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650c0c1-623b-4f6e-820a-75af58d0ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:34.999441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650c0c1-623b-4f6e-820a-75af58d0ea35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:35.000124 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650c0c1-623b-4f6e-820a-75af58d0ea35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:35.001729 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650c0c1-623b-4f6e-820a-75af58d0ea35 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:35.013337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1377/2776] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:35.019882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bde6e-7ce7-4a2d-a457-5c5e454104ee admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:35.030418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bde6e-7ce7-4a2d-a457-5c5e454104ee admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:35.035831 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6980ec8-690b-4f08-bd16-7ab23b78e1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:35.036953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6980ec8-690b-4f08-bd16-7ab23b78e1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:35.037458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6980ec8-690b-4f08-bd16-7ab23b78e1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:35.037986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6980ec8-690b-4f08-bd16-7ab23b78e1b7 admin admin] PATH_INFO: `/v3/projects/18f373bc13a945718162ddf8ade929b5/users/589b525c6b534a45a9330c89774ab638/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:35.056586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6980ec8-690b-4f08-bd16-7ab23b78e1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f373bc13a945718162ddf8ade929b5, user_id=589b525c6b534a45a9330c89774ab638, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:35.059852 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6980ec8-690b-4f08-bd16-7ab23b78e1b7 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:35.142519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:35.148252 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1400/2777] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:35 2022] PUT /identity/v3/projects/18f373bc13a945718162ddf8ade929b5/users/589b525c6b534a45a9330c89774ab638/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:35.152550 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650c0c1-623b-4f6e-820a-75af58d0ea35 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:35.163195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650c0c1-623b-4f6e-820a-75af58d0ea35 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:35.223562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f77253-c71c-41de-ac9b-a6105484bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:35.224190 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f77253-c71c-41de-ac9b-a6105484bb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:35.224475 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f77253-c71c-41de-ac9b-a6105484bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:35.224817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f77253-c71c-41de-ac9b-a6105484bb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:35.225443 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f77253-c71c-41de-ac9b-a6105484bb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:35.227027 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f77253-c71c-41de-ac9b-a6105484bb5a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:35.237212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1378/2778] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:35.241454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6980ec8-690b-4f08-bd16-7ab23b78e1b7 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:35.252088 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6980ec8-690b-4f08-bd16-7ab23b78e1b7 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:35.256727 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf74f-0352-4eb5-8c31-f315ad73f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:35.257390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf74f-0352-4eb5-8c31-f315ad73f220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:35.257676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf74f-0352-4eb5-8c31-f315ad73f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:35.257954 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf74f-0352-4eb5-8c31-f315ad73f220 admin admin] PATH_INFO: `/v3/projects/18f373bc13a945718162ddf8ade929b5/users/589b525c6b534a45a9330c89774ab638/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:35.259891 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdf74f-0352-4eb5-8c31-f315ad73f220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f373bc13a945718162ddf8ade929b5, user_id=589b525c6b534a45a9330c89774ab638, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:35.263267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdf74f-0352-4eb5-8c31-f315ad73f220 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:35.274386 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1401/2779] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:35 2022] PUT /identity/v3/projects/18f373bc13a945718162ddf8ade929b5/users/589b525c6b534a45a9330c89774ab638/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:41.969493 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154a6a-eb17-4ef2-8d34-067aff49bfdd None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:41.970505 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154a6a-eb17-4ef2-8d34-067aff49bfdd None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:41.971099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154a6a-eb17-4ef2-8d34-067aff49bfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:42.015674 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-30154a6a-eb17-4ef2-8d34-067aff49bfdd None None] MFA Rules not processed for user `589b525c6b534a45a9330c89774ab638`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:42.017790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-30154a6a-eb17-4ef2-8d34-067aff49bfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:42.031891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:42.113862 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1379/2780] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:42.130978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf74f-0352-4eb5-8c31-f315ad73f220 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:42.133491 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b2cdf74f-0352-4eb5-8c31-f315ad73f220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:42.215515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf74f-0352-4eb5-8c31-f315ad73f220 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:42.220106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0d9d0-58dd-45a5-8ded-0ef3671400bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'decb5421872c4034bbbaa8c3cd9dcb5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:42.220787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0d9d0-58dd-45a5-8ded-0ef3671400bc service glance] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:42.221072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0d9d0-58dd-45a5-8ded-0ef3671400bc service glance] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:42.221346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0d9d0-58dd-45a5-8ded-0ef3671400bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:42.292610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0d9d0-58dd-45a5-8ded-0ef3671400bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:42.294721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0d9d0-58dd-45a5-8ded-0ef3671400bc service glance] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:42.305497 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1402/2781] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:42.613293 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d2a7c-b8d7-4791-b94f-a92b4297951f None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:42.613585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d2a7c-b8d7-4791-b94f-a92b4297951f None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:42.613918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d2a7c-b8d7-4791-b94f-a92b4297951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:42.642213 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-b02d2a7c-b8d7-4791-b94f-a92b4297951f None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:42.643919 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-b02d2a7c-b8d7-4791-b94f-a92b4297951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:42.714800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1380/2782] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:42.727946 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0d9d0-58dd-45a5-8ded-0ef3671400bc service glance] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:42.729782 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-98f0d9d0-58dd-45a5-8ded-0ef3671400bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:42.815384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0d9d0-58dd-45a5-8ded-0ef3671400bc service glance] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:42.820895 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35638-f8e3-4093-838b-0a9b8d6deaa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:42.821433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35638-f8e3-4093-838b-0a9b8d6deaa9 service swift] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:42.821807 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35638-f8e3-4093-838b-0a9b8d6deaa9 service swift] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:42.822054 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35638-f8e3-4093-838b-0a9b8d6deaa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:42.831523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35638-f8e3-4093-838b-0a9b8d6deaa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:42.833784 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35638-f8e3-4093-838b-0a9b8d6deaa9 service swift] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:42.844430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1403/2783] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:25:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:25:46.108090 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d2a7c-b8d7-4791-b94f-a92b4297951f None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:46.194691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d2a7c-b8d7-4791-b94f-a92b4297951f None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:46.198695 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798869-b608-4abb-879c-4142a04d37c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:46.199298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798869-b608-4abb-879c-4142a04d37c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:46.199577 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798869-b608-4abb-879c-4142a04d37c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:46.201132 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798869-b608-4abb-879c-4142a04d37c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:46.202977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-11798869-b608-4abb-879c-4142a04d37c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:46.274789 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:46.338818 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798869-b608-4abb-879c-4142a04d37c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:46.341234 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798869-b608-4abb-879c-4142a04d37c1 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:46.364196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1381/2784] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:50.856915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35638-f8e3-4093-838b-0a9b8d6deaa9 service swift] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:50.859262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e6e35638-f8e3-4093-838b-0a9b8d6deaa9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:50.905809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:50.907860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35638-f8e3-4093-838b-0a9b8d6deaa9 service swift] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:50.913901 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:50.914654 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:50.915044 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:50.915412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] PATH_INFO: `/v3/users/22369962f4954442ab2b873499889d39` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:50.917343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22369962f4954442ab2b873499889d39)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:50.919926 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:51.101872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22369962f4954442ab2b873499889d39'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.102695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22369962f4954442ab2b873499889d39'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.187841 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22369962f4954442ab2b873499889d39'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.188398 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22369962f4954442ab2b873499889d39'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.197916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-a62d89b9-db8a-4b0b-bb65-638b0e18e8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22369962f4954442ab2b873499889d39'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.221679 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1404/2785] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:50 2022] DELETE /identity/v3/users/22369962f4954442ab2b873499889d39 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:51.535586 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798869-b608-4abb-879c-4142a04d37c1 service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:51.553966 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798869-b608-4abb-879c-4142a04d37c1 service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:51.633100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:51.634838 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:51.635511 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:51.635989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] PATH_INFO: `/v3/projects/07392db69f6942fdbc6a05fad194926b` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:51.638242 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07392db69f6942fdbc6a05fad194926b)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:51.640411 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:51.766811 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07392db69f6942fdbc6a05fad194926b', 'request_id': 'req-b5d021b4-531d-46dc-acb2-9438f1ae6135'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.774034 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07392db69f6942fdbc6a05fad194926b', 'request_id': 'req-b5d021b4-531d-46dc-acb2-9438f1ae6135'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.884393 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07392db69f6942fdbc6a05fad194926b', 'request_id': 'req-b5d021b4-531d-46dc-acb2-9438f1ae6135'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.898731 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] The token cache is being invalidate because project 07392db69f6942fdbc6a05fad194926b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:51.899169 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.900191 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-b5d021b4-531d-46dc-acb2-9438f1ae6135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:51.902071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1382/2786] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:51 2022] DELETE /identity/v3/projects/07392db69f6942fdbc6a05fad194926b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:51.907883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ffde7-1379-4aa2-b86a-8420757636ed None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:51.907883 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ffde7-1379-4aa2-b86a-8420757636ed None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:51.908509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ffde7-1379-4aa2-b86a-8420757636ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:51.977443 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-6f2ffde7-1379-4aa2-b86a-8420757636ed None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:51.978666 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6f2ffde7-1379-4aa2-b86a-8420757636ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:52.059872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1405/2787] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:52.060713 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03916-17fa-40fb-97b6-a33e0704f961 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:52.061106 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03916-17fa-40fb-97b6-a33e0704f961 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:52.061451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03916-17fa-40fb-97b6-a33e0704f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:52.086283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ffe03916-17fa-40fb-97b6-a33e0704f961 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:52.086283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ffe03916-17fa-40fb-97b6-a33e0704f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:52.095184 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1383/2788] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:52.099499 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ffde7-1379-4aa2-b86a-8420757636ed None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:52.110572 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ffde7-1379-4aa2-b86a-8420757636ed None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:52.115598 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471e4c-f5d1-4534-b00e-6669adbf3a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:52.120409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471e4c-f5d1-4534-b00e-6669adbf3a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:52.120409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471e4c-f5d1-4534-b00e-6669adbf3a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:52.120409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471e4c-f5d1-4534-b00e-6669adbf3a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:52.120409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79471e4c-f5d1-4534-b00e-6669adbf3a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:25:52.120409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79471e4c-f5d1-4534-b00e-6669adbf3a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:52.120409 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79471e4c-f5d1-4534-b00e-6669adbf3a0f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:52.134560 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1406/2789] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:25:52.138834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe03916-17fa-40fb-97b6-a33e0704f961 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:52.148845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe03916-17fa-40fb-97b6-a33e0704f961 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:52.156157 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95011993-9552-4396-b824-3e925ab0904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:52.156775 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95011993-9552-4396-b824-3e925ab0904a admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:52.157060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95011993-9552-4396-b824-3e925ab0904a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:52.157332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95011993-9552-4396-b824-3e925ab0904a admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:52.157982 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95011993-9552-4396-b824-3e925ab0904a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:52.160008 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95011993-9552-4396-b824-3e925ab0904a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:52.170575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:52.276220 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1384/2790] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:52 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:52.280373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471e4c-f5d1-4534-b00e-6669adbf3a0f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:52.294283 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471e4c-f5d1-4534-b00e-6669adbf3a0f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:52.336696 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:52.371194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d35815-457c-4b9c-a188-9ca3164af2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:52.372748 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d35815-457c-4b9c-a188-9ca3164af2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:52.373034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d35815-457c-4b9c-a188-9ca3164af2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:52.373301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d35815-457c-4b9c-a188-9ca3164af2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:52.373950 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d35815-457c-4b9c-a188-9ca3164af2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:52.375878 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d35815-457c-4b9c-a188-9ca3164af2a4 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:52.474721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1407/2791] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:52 2022] POST /identity/v3/users => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:52.479743 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95011993-9552-4396-b824-3e925ab0904a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:52.491389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95011993-9552-4396-b824-3e925ab0904a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:52.498145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c9374-2f51-420d-93bc-adfad2a62000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:52.498663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c9374-2f51-420d-93bc-adfad2a62000 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:52.498953 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c9374-2f51-420d-93bc-adfad2a62000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:52.499232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c9374-2f51-420d-93bc-adfad2a62000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:52.499936 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c9374-2f51-420d-93bc-adfad2a62000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:52.501615 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c9374-2f51-420d-93bc-adfad2a62000 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:52.515672 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1385/2792] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:52.517557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d35815-457c-4b9c-a188-9ca3164af2a4 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:52.529190 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d35815-457c-4b9c-a188-9ca3164af2a4 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:52.534279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f72c39-2ef2-432c-8663-8b64886ea7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:52.534916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f72c39-2ef2-432c-8663-8b64886ea7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:52.535206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f72c39-2ef2-432c-8663-8b64886ea7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:52.535484 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f72c39-2ef2-432c-8663-8b64886ea7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:52.536205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f72c39-2ef2-432c-8663-8b64886ea7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:52.537849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f72c39-2ef2-432c-8663-8b64886ea7ad admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:52.550334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1408/2793] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:52.554760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c9374-2f51-420d-93bc-adfad2a62000 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:52.566315 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c9374-2f51-420d-93bc-adfad2a62000 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:52.571330 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68634d5f-87cc-4ded-823a-cda62dcbaad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:52.572065 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68634d5f-87cc-4ded-823a-cda62dcbaad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:52.572353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68634d5f-87cc-4ded-823a-cda62dcbaad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:52.572632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68634d5f-87cc-4ded-823a-cda62dcbaad3 admin admin] PATH_INFO: `/v3/projects/91d9f4b6414c4bb499af8b6926239a09/users/11bd541a233b4692bf8014d87ccccdad/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:52.590622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68634d5f-87cc-4ded-823a-cda62dcbaad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d9f4b6414c4bb499af8b6926239a09, user_id=11bd541a233b4692bf8014d87ccccdad, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:52.593353 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68634d5f-87cc-4ded-823a-cda62dcbaad3 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:52.868699 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1386/2794] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:52 2022] PUT /identity/v3/projects/91d9f4b6414c4bb499af8b6926239a09/users/11bd541a233b4692bf8014d87ccccdad/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:52.881129 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea43651-2f25-45cb-841e-4923fbde36ff None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:52.881418 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea43651-2f25-45cb-841e-4923fbde36ff None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:52.881691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea43651-2f25-45cb-841e-4923fbde36ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:52.910316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-dea43651-2f25-45cb-841e-4923fbde36ff None None] MFA Rules not processed for user `11bd541a233b4692bf8014d87ccccdad`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:52.911515 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-dea43651-2f25-45cb-841e-4923fbde36ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:52.978358 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1409/2795] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:52.983407 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68634d5f-87cc-4ded-823a-cda62dcbaad3 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:53.053386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68634d5f-87cc-4ded-823a-cda62dcbaad3 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:53.057948 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a536ef-53ac-4142-818a-c4b972509d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:53.058581 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a536ef-53ac-4142-818a-c4b972509d8f admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:53.058863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a536ef-53ac-4142-818a-c4b972509d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:53.059165 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a536ef-53ac-4142-818a-c4b972509d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:53.059829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a536ef-53ac-4142-818a-c4b972509d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:53.061760 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a536ef-53ac-4142-818a-c4b972509d8f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:53.185437 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1387/2796] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:52 2022] POST /identity/v3/projects => generated 405 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:53.186872 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea43651-2f25-45cb-841e-4923fbde36ff None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:53.200911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea43651-2f25-45cb-841e-4923fbde36ff None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:53.273639 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0e893-0f42-4fda-8e0b-6d7db017d0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:53.274545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0e893-0f42-4fda-8e0b-6d7db017d0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:53.276918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0e893-0f42-4fda-8e0b-6d7db017d0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:53.276918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0e893-0f42-4fda-8e0b-6d7db017d0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:53.276918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0e893-0f42-4fda-8e0b-6d7db017d0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:53.278437 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0e893-0f42-4fda-8e0b-6d7db017d0e3 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:53.391768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1410/2797] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:53 2022] POST /identity/v3/users => generated 309 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:53.393198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a536ef-53ac-4142-818a-c4b972509d8f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:53.408785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a536ef-53ac-4142-818a-c4b972509d8f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:53.413702 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb408-fca9-4ffb-a7c5-0c7923cf476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:53.414313 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb408-fca9-4ffb-a7c5-0c7923cf476f admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:53.414595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb408-fca9-4ffb-a7c5-0c7923cf476f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:53.414868 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb408-fca9-4ffb-a7c5-0c7923cf476f admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:53.415515 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4eb408-fca9-4ffb-a7c5-0c7923cf476f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:53.417205 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4eb408-fca9-4ffb-a7c5-0c7923cf476f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:53.432842 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1388/2798] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:53.434589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0e893-0f42-4fda-8e0b-6d7db017d0e3 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:53.459492 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0e893-0f42-4fda-8e0b-6d7db017d0e3 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:53.465328 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dbf9b-961f-4b20-a4ce-a7bfd21a8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:53.471167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dbf9b-961f-4b20-a4ce-a7bfd21a8263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:53.471167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dbf9b-961f-4b20-a4ce-a7bfd21a8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:53.471167 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dbf9b-961f-4b20-a4ce-a7bfd21a8263 admin admin] PATH_INFO: `/v3/projects/519617678429421980e82c3ecb36a490/users/d4a6fa9168864ff1b560269eb1cdd1ff/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:53.485412 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dbf9b-961f-4b20-a4ce-a7bfd21a8263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519617678429421980e82c3ecb36a490, user_id=d4a6fa9168864ff1b560269eb1cdd1ff, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:53.489208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dbf9b-961f-4b20-a4ce-a7bfd21a8263 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:53.665865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1411/2799] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:53 2022] PUT /identity/v3/projects/519617678429421980e82c3ecb36a490/users/d4a6fa9168864ff1b560269eb1cdd1ff/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:53.670761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb408-fca9-4ffb-a7c5-0c7923cf476f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:53.685422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb408-fca9-4ffb-a7c5-0c7923cf476f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:53.752920 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75811b72-8ed1-4286-9938-ae01ca8bf684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:53.753528 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811b72-8ed1-4286-9938-ae01ca8bf684 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:53.753860 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811b72-8ed1-4286-9938-ae01ca8bf684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:53.754120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811b72-8ed1-4286-9938-ae01ca8bf684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:53.754899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75811b72-8ed1-4286-9938-ae01ca8bf684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:53.756547 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75811b72-8ed1-4286-9938-ae01ca8bf684 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:53.767202 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1389/2800] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:53.771428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dbf9b-961f-4b20-a4ce-a7bfd21a8263 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:53.782456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dbf9b-961f-4b20-a4ce-a7bfd21a8263 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:53.787178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dc122-4041-4e03-af3d-f6a7c14333cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:53.787862 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dc122-4041-4e03-af3d-f6a7c14333cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:53.788141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dc122-4041-4e03-af3d-f6a7c14333cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:53.788414 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dc122-4041-4e03-af3d-f6a7c14333cf admin admin] PATH_INFO: `/v3/projects/519617678429421980e82c3ecb36a490/users/d4a6fa9168864ff1b560269eb1cdd1ff/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:53.790299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dc122-4041-4e03-af3d-f6a7c14333cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=519617678429421980e82c3ecb36a490, user_id=d4a6fa9168864ff1b560269eb1cdd1ff, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:53.792981 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dc122-4041-4e03-af3d-f6a7c14333cf admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:53.795333 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:53.804262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1412/2801] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:53 2022] PUT /identity/v3/projects/519617678429421980e82c3ecb36a490/users/d4a6fa9168864ff1b560269eb1cdd1ff/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:53.814724 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db58284-bd30-47c0-af67-f85fdbb7e779 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:53.815009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db58284-bd30-47c0-af67-f85fdbb7e779 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:53.815402 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db58284-bd30-47c0-af67-f85fdbb7e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:53.849733 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-6db58284-bd30-47c0-af67-f85fdbb7e779 None None] MFA Rules not processed for user `d4a6fa9168864ff1b560269eb1cdd1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:53.852589 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-6db58284-bd30-47c0-af67-f85fdbb7e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:53.864015 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:53.920965 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1390/2802] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:53.932040 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dc122-4041-4e03-af3d-f6a7c14333cf admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:53.933744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b19dc122-4041-4e03-af3d-f6a7c14333cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:53.995025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dc122-4041-4e03-af3d-f6a7c14333cf admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:54.000030 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7940f-e5d9-42f1-ba6e-bed0db528383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:54.000674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7940f-e5d9-42f1-ba6e-bed0db528383 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:54.000955 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7940f-e5d9-42f1-ba6e-bed0db528383 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:54.001236 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7940f-e5d9-42f1-ba6e-bed0db528383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:54.011542 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7940f-e5d9-42f1-ba6e-bed0db528383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:54.013014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7940f-e5d9-42f1-ba6e-bed0db528383 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:54.025314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1413/2803] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:53 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:54.105325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03432f8e-7cca-49b6-93ca-696cb655a206 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:54.105610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03432f8e-7cca-49b6-93ca-696cb655a206 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:54.105888 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03432f8e-7cca-49b6-93ca-696cb655a206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:54.139149 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-03432f8e-7cca-49b6-93ca-696cb655a206 None None] MFA Rules not processed for user `25a397e3b5ba45e9af4efdd33ccc8963`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:54.140741 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-03432f8e-7cca-49b6-93ca-696cb655a206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:54.177308 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7940f-e5d9-42f1-ba6e-bed0db528383 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:54.199245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1391/2804] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:54.245295 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7940f-e5d9-42f1-ba6e-bed0db528383 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:54.250095 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:54.250738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:54.251025 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:54.251354 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] PATH_INFO: `/v3/users/11bd541a233b4692bf8014d87ccccdad` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:54.252487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11bd541a233b4692bf8014d87ccccdad)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:54.254404 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:54.454593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11bd541a233b4692bf8014d87ccccdad'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:54.455247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11bd541a233b4692bf8014d87ccccdad'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:54.534138 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11bd541a233b4692bf8014d87ccccdad'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:54.534787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11bd541a233b4692bf8014d87ccccdad'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:54.542956 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11bd541a233b4692bf8014d87ccccdad'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:54.564299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1414/2805] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:54 2022] DELETE /identity/v3/users/11bd541a233b4692bf8014d87ccccdad => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:54.569072 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7a865-b8b2-41ba-91c3-0249f69e690b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:54.569360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7a865-b8b2-41ba-91c3-0249f69e690b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:54.569685 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7a865-b8b2-41ba-91c3-0249f69e690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:54.591706 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-0cf7a865-b8b2-41ba-91c3-0249f69e690b None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:54.593186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0cf7a865-b8b2-41ba-91c3-0249f69e690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:54.662642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1392/2806] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:54.672630 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:54.674086 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:54.693120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:54.735525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c164f8-f86a-4758-8735-96b9c890d5c6 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:54.739128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac9b7e-8203-4f53-aecd-9e3874193a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:54.739765 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9b7e-8203-4f53-aecd-9e3874193a66 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:54.740045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9b7e-8203-4f53-aecd-9e3874193a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:54.740316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9b7e-8203-4f53-aecd-9e3874193a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:54.748975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac9b7e-8203-4f53-aecd-9e3874193a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:54.750382 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac9b7e-8203-4f53-aecd-9e3874193a66 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:54.759506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1415/2807] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:25:55.187910 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7a865-b8b2-41ba-91c3-0249f69e690b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:55.189675 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0cf7a865-b8b2-41ba-91c3-0249f69e690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:55.204289 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7a865-b8b2-41ba-91c3-0249f69e690b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:55.210105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:55.210947 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:55.211284 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:55.211538 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] PATH_INFO: `/v3/projects/91d9f4b6414c4bb499af8b6926239a09` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:55.213086 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d9f4b6414c4bb499af8b6926239a09)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:55.214878 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:55.540732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d9f4b6414c4bb499af8b6926239a09', 'request_id': 'req-9a428cb1-e2fd-4227-94e4-551b0d69ae98'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:55.541739 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:55.547398 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d9f4b6414c4bb499af8b6926239a09', 'request_id': 'req-9a428cb1-e2fd-4227-94e4-551b0d69ae98'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:55.610936 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac9b7e-8203-4f53-aecd-9e3874193a66 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:55.613282 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b8ac9b7e-8203-4f53-aecd-9e3874193a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:55.632821 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d9f4b6414c4bb499af8b6926239a09', 'request_id': 'req-9a428cb1-e2fd-4227-94e4-551b0d69ae98'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:55.646974 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] The token cache is being invalidate because project 91d9f4b6414c4bb499af8b6926239a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:55.647345 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:55.648192 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:55.652992 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1393/2808] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:55 2022] DELETE /identity/v3/projects/91d9f4b6414c4bb499af8b6926239a09 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:55.654587 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:55.656758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:55.712379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac9b7e-8203-4f53-aecd-9e3874193a66 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:55.727568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a428cb1-e2fd-4227-94e4-551b0d69ae98 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:55.732619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:55.733426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:55.733826 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:55.734161 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] PATH_INFO: `/v3/users/d4a6fa9168864ff1b560269eb1cdd1ff` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:55.735244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a6fa9168864ff1b560269eb1cdd1ff)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:55.737210 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:55.780031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12864637-1b0b-4d8d-8741-b1f40c3dd7b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:55.780637 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12864637-1b0b-4d8d-8741-b1f40c3dd7b5 service placement] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:55.780918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12864637-1b0b-4d8d-8741-b1f40c3dd7b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:55.781194 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12864637-1b0b-4d8d-8741-b1f40c3dd7b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:55.782941 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-12864637-1b0b-4d8d-8741-b1f40c3dd7b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:55.794211 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12864637-1b0b-4d8d-8741-b1f40c3dd7b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:55.795758 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12864637-1b0b-4d8d-8741-b1f40c3dd7b5 service placement] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:55.805650 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1416/2809] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:25:56.007108 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a6fa9168864ff1b560269eb1cdd1ff'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.067548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a6fa9168864ff1b560269eb1cdd1ff'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.080929 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a6fa9168864ff1b560269eb1cdd1ff'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.081813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a6fa9168864ff1b560269eb1cdd1ff'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.088670 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-c7de27f2-d516-434d-96cb-8b7f1b32f70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a6fa9168864ff1b560269eb1cdd1ff'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.095119 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1394/2810] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:25:55 2022] DELETE /identity/v3/users/d4a6fa9168864ff1b560269eb1cdd1ff => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:25:56.561622 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12864637-1b0b-4d8d-8741-b1f40c3dd7b5 service placement] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:56.573106 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12864637-1b0b-4d8d-8741-b1f40c3dd7b5 service placement] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:56.614889 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=100 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:56.645197 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:56.645834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:56.646136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:56.646410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] PATH_INFO: `/v3/projects/519617678429421980e82c3ecb36a490` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:56.647516 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519617678429421980e82c3ecb36a490)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:56.649691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:56.746324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519617678429421980e82c3ecb36a490', 'request_id': 'req-d044ade8-0fc9-41aa-8cf9-02c67f842176'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.810842 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519617678429421980e82c3ecb36a490', 'request_id': 'req-d044ade8-0fc9-41aa-8cf9-02c67f842176'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.818582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519617678429421980e82c3ecb36a490', 'request_id': 'req-d044ade8-0fc9-41aa-8cf9-02c67f842176'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.830195 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] The token cache is being invalidate because project 519617678429421980e82c3ecb36a490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:25:56.830628 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.831868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d044ade8-0fc9-41aa-8cf9-02c67f842176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:25:56.833496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1417/2811] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:25:56 2022] DELETE /identity/v3/projects/519617678429421980e82c3ecb36a490 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:56.840094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7bc09-3ee6-4145-9666-4430322a95f2 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:56.841121 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7bc09-3ee6-4145-9666-4430322a95f2 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:56.842070 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7bc09-3ee6-4145-9666-4430322a95f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:56.875113 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-d8e7bc09-3ee6-4145-9666-4430322a95f2 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:56.876382 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-d8e7bc09-3ee6-4145-9666-4430322a95f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:56.927265 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:56.936332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1395/2812] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:56.944227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3e54f-817b-4f73-9617-caf08cc5e105 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:56.944514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3e54f-817b-4f73-9617-caf08cc5e105 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:56.944786 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3e54f-817b-4f73-9617-caf08cc5e105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:56.966104 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-aea3e54f-817b-4f73-9617-caf08cc5e105 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:56.967991 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-aea3e54f-817b-4f73-9617-caf08cc5e105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:56.975974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1418/2813] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:56.980395 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7bc09-3ee6-4145-9666-4430322a95f2 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:56.990899 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7bc09-3ee6-4145-9666-4430322a95f2 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:56.995568 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d4705-d8e0-4872-bd5e-d51e3cb87715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:57.003278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4705-d8e0-4872-bd5e-d51e3cb87715 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:57.003278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4705-d8e0-4872-bd5e-d51e3cb87715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:57.003278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4705-d8e0-4872-bd5e-d51e3cb87715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:57.003278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d4705-d8e0-4872-bd5e-d51e3cb87715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:25:57.003278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d4705-d8e0-4872-bd5e-d51e3cb87715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:57.003278 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d4705-d8e0-4872-bd5e-d51e3cb87715 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:57.011166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1396/2814] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:25:57.016177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3e54f-817b-4f73-9617-caf08cc5e105 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:57.025975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3e54f-817b-4f73-9617-caf08cc5e105 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:57.031411 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921ba3-eab0-479c-aa77-978126656b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:57.032048 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921ba3-eab0-479c-aa77-978126656b8a admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:57.032327 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921ba3-eab0-479c-aa77-978126656b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:57.032661 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921ba3-eab0-479c-aa77-978126656b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:57.033245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7921ba3-eab0-479c-aa77-978126656b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:57.035102 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7921ba3-eab0-479c-aa77-978126656b8a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:57.125882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1419/2815] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:57 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:25:57.130737 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d4705-d8e0-4872-bd5e-d51e3cb87715 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:57.141680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d4705-d8e0-4872-bd5e-d51e3cb87715 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:57.215797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e4116-4833-40fb-8dbf-24b941c01c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:57.219885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e4116-4833-40fb-8dbf-24b941c01c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:57.219885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e4116-4833-40fb-8dbf-24b941c01c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:57.219885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e4116-4833-40fb-8dbf-24b941c01c37 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:57.219885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e4116-4833-40fb-8dbf-24b941c01c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:57.219885 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e4116-4833-40fb-8dbf-24b941c01c37 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:57.325359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1397/2816] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:57 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:57.330170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921ba3-eab0-479c-aa77-978126656b8a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:57.340770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921ba3-eab0-479c-aa77-978126656b8a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:57.345429 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571106e-37d0-4d08-bf10-97290b6fae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:57.346034 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571106e-37d0-4d08-bf10-97290b6fae22 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:57.346316 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571106e-37d0-4d08-bf10-97290b6fae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:57.346594 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571106e-37d0-4d08-bf10-97290b6fae22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:57.347237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571106e-37d0-4d08-bf10-97290b6fae22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:57.348860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571106e-37d0-4d08-bf10-97290b6fae22 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:57.358759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1420/2817] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:57.362785 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e4116-4833-40fb-8dbf-24b941c01c37 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:57.373227 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e4116-4833-40fb-8dbf-24b941c01c37 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:57.377904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85087a2-e744-4c78-b4ab-60b7068bf9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:57.378498 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85087a2-e744-4c78-b4ab-60b7068bf9ae admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:57.378783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85087a2-e744-4c78-b4ab-60b7068bf9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:57.379055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85087a2-e744-4c78-b4ab-60b7068bf9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:57.379738 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85087a2-e744-4c78-b4ab-60b7068bf9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:57.381312 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85087a2-e744-4c78-b4ab-60b7068bf9ae admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:57.393514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1398/2818] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:57.397670 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571106e-37d0-4d08-bf10-97290b6fae22 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:57.407570 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571106e-37d0-4d08-bf10-97290b6fae22 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:57.412115 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a42fa-1033-462b-87dd-c9fadf011477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:57.412753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a42fa-1033-462b-87dd-c9fadf011477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:57.413031 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a42fa-1033-462b-87dd-c9fadf011477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:57.413301 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a42fa-1033-462b-87dd-c9fadf011477 admin admin] PATH_INFO: `/v3/projects/d17a2b34cc2d43fea21a0f1c3eeb5f39/users/c0b33a09db4441d0aa9d0a8aa1d0c92c/roles/df79e12324de40afbb353b95363811cc` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:57.428055 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a42fa-1033-462b-87dd-c9fadf011477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17a2b34cc2d43fea21a0f1c3eeb5f39, user_id=c0b33a09db4441d0aa9d0a8aa1d0c92c, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:57.430662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a42fa-1033-462b-87dd-c9fadf011477 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:57.520519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1421/2819] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:57 2022] PUT /identity/v3/projects/d17a2b34cc2d43fea21a0f1c3eeb5f39/users/c0b33a09db4441d0aa9d0a8aa1d0c92c/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:57.532931 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64b37b-c428-4566-9b26-c49d3d479264 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:57.533246 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64b37b-c428-4566-9b26-c49d3d479264 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:57.533518 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64b37b-c428-4566-9b26-c49d3d479264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:57.564095 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-cf64b37b-c428-4566-9b26-c49d3d479264 None None] MFA Rules not processed for user `c0b33a09db4441d0aa9d0a8aa1d0c92c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:57.565553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-cf64b37b-c428-4566-9b26-c49d3d479264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:57.631506 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1399/2820] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:57.635763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a42fa-1033-462b-87dd-c9fadf011477 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:57.700307 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:57.706945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a42fa-1033-462b-87dd-c9fadf011477 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:57.711903 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d9abe-bf2c-4de7-a6ff-fb725d75f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:57.712530 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d9abe-bf2c-4de7-a6ff-fb725d75f327 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:57.712814 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d9abe-bf2c-4de7-a6ff-fb725d75f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:57.713127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d9abe-bf2c-4de7-a6ff-fb725d75f327 admin admin] PATH_INFO: `/v3/projects` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:57.713752 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d9abe-bf2c-4de7-a6ff-fb725d75f327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:57.715684 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d9abe-bf2c-4de7-a6ff-fb725d75f327 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:57.838586 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1422/2821] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:25:57 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:57.842787 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64b37b-c428-4566-9b26-c49d3d479264 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:57.853595 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64b37b-c428-4566-9b26-c49d3d479264 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:57.904955 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:57.913682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1cec5-7b87-44fc-9c8c-905755383938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:57.914334 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1cec5-7b87-44fc-9c8c-905755383938 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:57.914638 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1cec5-7b87-44fc-9c8c-905755383938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:57.914892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1cec5-7b87-44fc-9c8c-905755383938 admin admin] PATH_INFO: `/v3/users` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:57.915546 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1cec5-7b87-44fc-9c8c-905755383938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:57.918708 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1cec5-7b87-44fc-9c8c-905755383938 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:57.987531 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1400/2822] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:25:57 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:25:57.995970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d9abe-bf2c-4de7-a6ff-fb725d75f327 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:58.009087 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d9abe-bf2c-4de7-a6ff-fb725d75f327 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:58.015557 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc60983-5d8a-46f4-a6e6-2505a19f568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:58.016629 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc60983-5d8a-46f4-a6e6-2505a19f568a admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:58.016929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc60983-5d8a-46f4-a6e6-2505a19f568a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:58.017208 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc60983-5d8a-46f4-a6e6-2505a19f568a admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:58.017874 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc60983-5d8a-46f4-a6e6-2505a19f568a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:58.019551 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc60983-5d8a-46f4-a6e6-2505a19f568a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:58.031550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1423/2823] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:58.036765 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1cec5-7b87-44fc-9c8c-905755383938 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:58.051769 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1cec5-7b87-44fc-9c8c-905755383938 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:58.057755 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652326e6-dd44-41c0-90b7-4a3c209e9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:58.058458 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652326e6-dd44-41c0-90b7-4a3c209e9491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:58.059320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652326e6-dd44-41c0-90b7-4a3c209e9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:58.059320 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652326e6-dd44-41c0-90b7-4a3c209e9491 admin admin] PATH_INFO: `/v3/projects/e78caa1aa62e49daa172fc98096e5169/users/b41d3063ad9f49ac8c74f77dd69ed255/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:58.075369 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652326e6-dd44-41c0-90b7-4a3c209e9491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78caa1aa62e49daa172fc98096e5169, user_id=b41d3063ad9f49ac8c74f77dd69ed255, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:58.078125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652326e6-dd44-41c0-90b7-4a3c209e9491 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:58.158298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1401/2824] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:58 2022] PUT /identity/v3/projects/e78caa1aa62e49daa172fc98096e5169/users/b41d3063ad9f49ac8c74f77dd69ed255/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:58.162118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc60983-5d8a-46f4-a6e6-2505a19f568a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:58.174438 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc60983-5d8a-46f4-a6e6-2505a19f568a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:58.233360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb5bd4-2dba-4e2e-ab56-6a73408f703c None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:58.233707 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb5bd4-2dba-4e2e-ab56-6a73408f703c None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:58.233923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb5bd4-2dba-4e2e-ab56-6a73408f703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:58.259843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93a0a-641c-4d8f-9ce7-1c728c2e8838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:58.260959 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93a0a-641c-4d8f-9ce7-1c728c2e8838 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:58.260959 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93a0a-641c-4d8f-9ce7-1c728c2e8838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:58.261406 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93a0a-641c-4d8f-9ce7-1c728c2e8838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:58.262228 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93a0a-641c-4d8f-9ce7-1c728c2e8838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:58.265704 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93a0a-641c-4d8f-9ce7-1c728c2e8838 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:58.269790 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-51fb5bd4-2dba-4e2e-ab56-6a73408f703c None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:58.271021 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-51fb5bd4-2dba-4e2e-ab56-6a73408f703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:58.278073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1424/2825] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:25:58.282916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93a0a-641c-4d8f-9ce7-1c728c2e8838 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:58.296152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93a0a-641c-4d8f-9ce7-1c728c2e8838 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:58.302038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7d86d-6214-4449-9c76-7c7e9cdfc947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:58.302706 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d86d-6214-4449-9c76-7c7e9cdfc947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:58.302995 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d86d-6214-4449-9c76-7c7e9cdfc947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:58.303279 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d86d-6214-4449-9c76-7c7e9cdfc947 admin admin] PATH_INFO: `/v3/projects/e78caa1aa62e49daa172fc98096e5169/users/b41d3063ad9f49ac8c74f77dd69ed255/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:58.305547 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7d86d-6214-4449-9c76-7c7e9cdfc947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78caa1aa62e49daa172fc98096e5169, user_id=b41d3063ad9f49ac8c74f77dd69ed255, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:58.308262 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7d86d-6214-4449-9c76-7c7e9cdfc947 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:58.321600 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1425/2826] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:25:58 2022] PUT /identity/v3/projects/e78caa1aa62e49daa172fc98096e5169/users/b41d3063ad9f49ac8c74f77dd69ed255/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:25:58.338227 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac5ec-6a24-49d6-9c27-5379a0ea81c8 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:58.338610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac5ec-6a24-49d6-9c27-5379a0ea81c8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:58.338868 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac5ec-6a24-49d6-9c27-5379a0ea81c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:58.356237 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1402/2827] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:25:58.370291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb5bd4-2dba-4e2e-ab56-6a73408f703c None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:58.371807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-51fb5bd4-2dba-4e2e-ab56-6a73408f703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:58.380610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-312ac5ec-6a24-49d6-9c27-5379a0ea81c8 None None] MFA Rules not processed for user `b41d3063ad9f49ac8c74f77dd69ed255`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:25:58.381849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-312ac5ec-6a24-49d6-9c27-5379a0ea81c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:58.450596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb5bd4-2dba-4e2e-ab56-6a73408f703c None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:58.460387 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1426/2828] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 12:25:58.468728 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ac5ec-6a24-49d6-9c27-5379a0ea81c8 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:25:58.470667 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-312ac5ec-6a24-49d6-9c27-5379a0ea81c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:25:58.522795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:58.533525 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:58.544285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae0223-36f8-4e58-95c8-0ea409b4444c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:58.544285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae0223-36f8-4e58-95c8-0ea409b4444c service swift] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:58.544285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae0223-36f8-4e58-95c8-0ea409b4444c service swift] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:58.544285 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae0223-36f8-4e58-95c8-0ea409b4444c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:58.548632 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ac5ec-6a24-49d6-9c27-5379a0ea81c8 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:25:58.554052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37afe8-2c4e-4f4a-b675-d3ccbd20dbd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:25:58.554052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37afe8-2c4e-4f4a-b675-d3ccbd20dbd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:25:58.554052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37afe8-2c4e-4f4a-b675-d3ccbd20dbd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:25:58.554456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37afe8-2c4e-4f4a-b675-d3ccbd20dbd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:25:58.627887 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae0223-36f8-4e58-95c8-0ea409b4444c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:58.630734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae0223-36f8-4e58-95c8-0ea409b4444c service swift] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:58.636260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37afe8-2c4e-4f4a-b675-d3ccbd20dbd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:25:58.637897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37afe8-2c4e-4f4a-b675-d3ccbd20dbd6 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:25:58.641423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1403/2829] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:25:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 12:25:58.657177 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1427/2830] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:25:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 12:26:00.572247 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae0223-36f8-4e58-95c8-0ea409b4444c service swift] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:00.573822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-9bae0223-36f8-4e58-95c8-0ea409b4444c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:00.588793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae0223-36f8-4e58-95c8-0ea409b4444c service swift] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:00.593379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f248d-ce51-4b96-b9d9-a6b092491d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:00.594030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f248d-ce51-4b96-b9d9-a6b092491d96 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:00.594310 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f248d-ce51-4b96-b9d9-a6b092491d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:00.594583 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f248d-ce51-4b96-b9d9-a6b092491d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:00.604652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f248d-ce51-4b96-b9d9-a6b092491d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:00.606386 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f248d-ce51-4b96-b9d9-a6b092491d96 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:00.626650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1404/2831] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:05.029489 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37afe8-2c4e-4f4a-b675-d3ccbd20dbd6 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:05.104469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37afe8-2c4e-4f4a-b675-d3ccbd20dbd6 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:05.110209 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:05.110865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:05.111150 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:05.111420 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] PATH_INFO: `/v3/users/c0b33a09db4441d0aa9d0a8aa1d0c92c` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:05.112682 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b33a09db4441d0aa9d0a8aa1d0c92c)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:05.114624 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:05.339063 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b33a09db4441d0aa9d0a8aa1d0c92c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:05.351120 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b33a09db4441d0aa9d0a8aa1d0c92c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:05.894823 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b33a09db4441d0aa9d0a8aa1d0c92c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:05.895565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b33a09db4441d0aa9d0a8aa1d0c92c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:05.907566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b33a09db4441d0aa9d0a8aa1d0c92c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:05.937287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1428/2832] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:05 2022] DELETE /identity/v3/users/c0b33a09db4441d0aa9d0a8aa1d0c92c => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:05.941714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6caca-a8d3-4889-bdf6-7512c1b3d4cb None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:05.942308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6caca-a8d3-4889-bdf6-7512c1b3d4cb None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:05.942308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6caca-a8d3-4889-bdf6-7512c1b3d4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:05.979283 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-bbf6caca-a8d3-4889-bdf6-7512c1b3d4cb None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:05.980759 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bbf6caca-a8d3-4889-bdf6-7512c1b3d4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:06.123379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1405/2833] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:06.141357 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:06.145709 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:06.174430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:06.303456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78ab9d-4b39-4e5d-bb4e-230cefa84bf9 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:06.311260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2939-8c89-428b-979c-203254ce2c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:06.312392 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2939-8c89-428b-979c-203254ce2c13 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:06.313005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2939-8c89-428b-979c-203254ce2c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:06.313651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2939-8c89-428b-979c-203254ce2c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:06.332363 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce2939-8c89-428b-979c-203254ce2c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:06.334857 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce2939-8c89-428b-979c-203254ce2c13 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:06.368424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1429/2834] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:06.852563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6caca-a8d3-4889-bdf6-7512c1b3d4cb None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:06.852563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-bbf6caca-a8d3-4889-bdf6-7512c1b3d4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:06.861578 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6caca-a8d3-4889-bdf6-7512c1b3d4cb None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:06.866440 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:06.867098 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:06.867389 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:06.867698 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] PATH_INFO: `/v3/projects/d17a2b34cc2d43fea21a0f1c3eeb5f39` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:06.868903 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17a2b34cc2d43fea21a0f1c3eeb5f39)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:06.870764 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:06.973200 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17a2b34cc2d43fea21a0f1c3eeb5f39', 'request_id': 'req-7cb3c801-2309-433e-85b1-d960257a3a84'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:06.980025 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17a2b34cc2d43fea21a0f1c3eeb5f39', 'request_id': 'req-7cb3c801-2309-433e-85b1-d960257a3a84'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:07.050651 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17a2b34cc2d43fea21a0f1c3eeb5f39', 'request_id': 'req-7cb3c801-2309-433e-85b1-d960257a3a84'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:07.062657 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] The token cache is being invalidate because project d17a2b34cc2d43fea21a0f1c3eeb5f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:07.062945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:07.063603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:07.065129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1406/2835] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:06 2022] DELETE /identity/v3/projects/d17a2b34cc2d43fea21a0f1c3eeb5f39 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:07.069458 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2939-8c89-428b-979c-203254ce2c13 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:07.081470 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2939-8c89-428b-979c-203254ce2c13 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:07.151032 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:07.151834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:07.152395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:07.152395 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] PATH_INFO: `/v3/users/b41d3063ad9f49ac8c74f77dd69ed255` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:07.153701 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41d3063ad9f49ac8c74f77dd69ed255)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:07.155839 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:07.407863 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41d3063ad9f49ac8c74f77dd69ed255'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:07.409075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41d3063ad9f49ac8c74f77dd69ed255'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:07.501939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41d3063ad9f49ac8c74f77dd69ed255'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:07.502585 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41d3063ad9f49ac8c74f77dd69ed255'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:07.510962 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-6bed07d1-a879-48f3-9773-c0a93cbc74d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41d3063ad9f49ac8c74f77dd69ed255'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:07.530014 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1430/2836] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:07 2022] DELETE /identity/v3/users/b41d3063ad9f49ac8c74f77dd69ed255 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:07.955394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:07.957337 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:07.966031 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:07.972110 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3c801-2309-433e-85b1-d960257a3a84 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:08.029958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:08.030663 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.030853 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.031126 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] PATH_INFO: `/v3/projects/e78caa1aa62e49daa172fc98096e5169` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.032422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78caa1aa62e49daa172fc98096e5169)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:08.034317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:08.137522 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78caa1aa62e49daa172fc98096e5169', 'request_id': 'req-0afb2da7-2bfc-4764-a54a-3483eaccc977'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:08.143846 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78caa1aa62e49daa172fc98096e5169', 'request_id': 'req-0afb2da7-2bfc-4764-a54a-3483eaccc977'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:08.193254 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78caa1aa62e49daa172fc98096e5169', 'request_id': 'req-0afb2da7-2bfc-4764-a54a-3483eaccc977'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:08.204981 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] The token cache is being invalidate because project e78caa1aa62e49daa172fc98096e5169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:08.205199 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:08.205831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-0afb2da7-2bfc-4764-a54a-3483eaccc977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:08.207558 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1407/2837] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:07 2022] DELETE /identity/v3/projects/e78caa1aa62e49daa172fc98096e5169 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:26:08.212541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b248-9b8d-4d93-98b5-dfa7f9de2faa None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.213016 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b248-9b8d-4d93-98b5-dfa7f9de2faa None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.213144 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b248-9b8d-4d93-98b5-dfa7f9de2faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.233942 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-e2f0b248-9b8d-4d93-98b5-dfa7f9de2faa None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:08.235188 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-e2f0b248-9b8d-4d93-98b5-dfa7f9de2faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:08.245141 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:08.296372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1431/2838] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:08.305146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21ed87-237d-483a-9ad7-c39a8810b645 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.305417 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21ed87-237d-483a-9ad7-c39a8810b645 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.305652 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21ed87-237d-483a-9ad7-c39a8810b645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.326647 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-3e21ed87-237d-483a-9ad7-c39a8810b645 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:08.327895 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3e21ed87-237d-483a-9ad7-c39a8810b645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:08.336277 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1408/2839] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:08.340514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0b248-9b8d-4d93-98b5-dfa7f9de2faa None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:08.350476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0b248-9b8d-4d93-98b5-dfa7f9de2faa None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:08.355127 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97ac8a-bf13-47be-958c-b767e7d61d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:08.358505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ac8a-bf13-47be-958c-b767e7d61d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.358505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ac8a-bf13-47be-958c-b767e7d61d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.358505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ac8a-bf13-47be-958c-b767e7d61d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.358505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97ac8a-bf13-47be-958c-b767e7d61d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:26:08.358505 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97ac8a-bf13-47be-958c-b767e7d61d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:08.358983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97ac8a-bf13-47be-958c-b767e7d61d94 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:08.370703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1432/2840] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:26:08.375555 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21ed87-237d-483a-9ad7-c39a8810b645 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:08.384722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21ed87-237d-483a-9ad7-c39a8810b645 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:08.390050 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62113446-0d43-44f4-b742-8676fc8d97b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:08.390680 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62113446-0d43-44f4-b742-8676fc8d97b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.390958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62113446-0d43-44f4-b742-8676fc8d97b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.391233 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62113446-0d43-44f4-b742-8676fc8d97b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.392054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62113446-0d43-44f4-b742-8676fc8d97b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:08.393958 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62113446-0d43-44f4-b742-8676fc8d97b4 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:08.456802 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1409/2841] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:26:08 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:08.458046 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97ac8a-bf13-47be-958c-b767e7d61d94 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:08.468131 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97ac8a-bf13-47be-958c-b767e7d61d94 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:08.529143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a90cc-f88d-44f5-b04f-8593ff455c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:08.529763 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a90cc-f88d-44f5-b04f-8593ff455c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.530052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a90cc-f88d-44f5-b04f-8593ff455c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.530332 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a90cc-f88d-44f5-b04f-8593ff455c4d admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.530966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a90cc-f88d-44f5-b04f-8593ff455c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:08.532933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a90cc-f88d-44f5-b04f-8593ff455c4d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:08.616523 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1433/2842] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:26:08 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:08.620494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62113446-0d43-44f4-b742-8676fc8d97b4 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:08.630972 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62113446-0d43-44f4-b742-8676fc8d97b4 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:08.636392 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4e362-f22d-4c1c-a340-6cd02c896d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:08.637026 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e362-f22d-4c1c-a340-6cd02c896d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.637340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e362-f22d-4c1c-a340-6cd02c896d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.637658 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e362-f22d-4c1c-a340-6cd02c896d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.638362 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4e362-f22d-4c1c-a340-6cd02c896d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:08.640357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4e362-f22d-4c1c-a340-6cd02c896d2a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:08.650968 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1410/2843] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:08.655768 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a90cc-f88d-44f5-b04f-8593ff455c4d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:08.665985 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a90cc-f88d-44f5-b04f-8593ff455c4d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:08.671433 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e1145-714d-4cda-9e01-d95fa255fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:08.675753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1145-714d-4cda-9e01-d95fa255fbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.675753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1145-714d-4cda-9e01-d95fa255fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.675753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1145-714d-4cda-9e01-d95fa255fbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.675753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e1145-714d-4cda-9e01-d95fa255fbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:08.675753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e1145-714d-4cda-9e01-d95fa255fbc8 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:08.686320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1434/2844] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:08.690833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4e362-f22d-4c1c-a340-6cd02c896d2a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:08.701385 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4e362-f22d-4c1c-a340-6cd02c896d2a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:08.706527 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df706ed5-b290-4ddb-8906-19a456a937f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:08.707120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df706ed5-b290-4ddb-8906-19a456a937f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.707399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df706ed5-b290-4ddb-8906-19a456a937f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.707705 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df706ed5-b290-4ddb-8906-19a456a937f1 admin admin] PATH_INFO: `/v3/projects/e17ea53b118b4ca9a258b45af17c910c/users/a1b904c080f746b08daf02a3e4b55d9d/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.724275 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df706ed5-b290-4ddb-8906-19a456a937f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17ea53b118b4ca9a258b45af17c910c, user_id=a1b904c080f746b08daf02a3e4b55d9d, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:08.733432 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df706ed5-b290-4ddb-8906-19a456a937f1 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:08.862129 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1411/2845] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:08 2022] PUT /identity/v3/projects/e17ea53b118b4ca9a258b45af17c910c/users/a1b904c080f746b08daf02a3e4b55d9d/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:08.872565 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e2d64-f8ee-49fa-ad1e-b8275958fecf None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:08.872859 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e2d64-f8ee-49fa-ad1e-b8275958fecf None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:08.873136 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e2d64-f8ee-49fa-ad1e-b8275958fecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:08.901413 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-441e2d64-f8ee-49fa-ad1e-b8275958fecf None None] MFA Rules not processed for user `a1b904c080f746b08daf02a3e4b55d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:08.902662 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-441e2d64-f8ee-49fa-ad1e-b8275958fecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:08.969224 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1435/2846] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:08.973616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df706ed5-b290-4ddb-8906-19a456a937f1 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:09.004914 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:09.036551 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df706ed5-b290-4ddb-8906-19a456a937f1 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:09.041383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be08bd9-dc12-4221-9a33-3da781495330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:09.041997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be08bd9-dc12-4221-9a33-3da781495330 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:09.042281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be08bd9-dc12-4221-9a33-3da781495330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:09.042556 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be08bd9-dc12-4221-9a33-3da781495330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:09.043215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be08bd9-dc12-4221-9a33-3da781495330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:09.045938 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be08bd9-dc12-4221-9a33-3da781495330 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:09.147676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1412/2847] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:26:08 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:09.152751 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e2d64-f8ee-49fa-ad1e-b8275958fecf None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:09.162989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e2d64-f8ee-49fa-ad1e-b8275958fecf None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:09.171320 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:09.219118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cfdcb-25e0-43ef-88f5-e91dc99fa4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:09.219892 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cfdcb-25e0-43ef-88f5-e91dc99fa4cc admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:09.220038 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cfdcb-25e0-43ef-88f5-e91dc99fa4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:09.220314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cfdcb-25e0-43ef-88f5-e91dc99fa4cc admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:09.220978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cfdcb-25e0-43ef-88f5-e91dc99fa4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:09.222865 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cfdcb-25e0-43ef-88f5-e91dc99fa4cc admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:09.336928 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1436/2848] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:26:09 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:09.341061 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be08bd9-dc12-4221-9a33-3da781495330 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:09.351357 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be08bd9-dc12-4221-9a33-3da781495330 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:09.356676 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2924b90-ec35-4784-9faf-24d0e5ace9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:09.357319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2924b90-ec35-4784-9faf-24d0e5ace9db admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:09.357732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2924b90-ec35-4784-9faf-24d0e5ace9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:09.357967 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2924b90-ec35-4784-9faf-24d0e5ace9db admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:09.358619 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2924b90-ec35-4784-9faf-24d0e5ace9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:09.360245 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2924b90-ec35-4784-9faf-24d0e5ace9db admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:09.370500 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1413/2849] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:09.375073 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cfdcb-25e0-43ef-88f5-e91dc99fa4cc admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:09.385403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cfdcb-25e0-43ef-88f5-e91dc99fa4cc admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:09.390771 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a50df-e08d-4ba1-b626-32bd1b2c28f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:09.395457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a50df-e08d-4ba1-b626-32bd1b2c28f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:09.395457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a50df-e08d-4ba1-b626-32bd1b2c28f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:09.395457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a50df-e08d-4ba1-b626-32bd1b2c28f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:09.395457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a50df-e08d-4ba1-b626-32bd1b2c28f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:09.395457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a50df-e08d-4ba1-b626-32bd1b2c28f6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:09.404746 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1437/2850] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:09.408926 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2924b90-ec35-4784-9faf-24d0e5ace9db admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:09.420291 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2924b90-ec35-4784-9faf-24d0e5ace9db admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:09.426871 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022531da-8280-4c2f-9270-1ffb8d7c1c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:09.427537 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022531da-8280-4c2f-9270-1ffb8d7c1c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:09.430197 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022531da-8280-4c2f-9270-1ffb8d7c1c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:09.430484 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022531da-8280-4c2f-9270-1ffb8d7c1c9b admin admin] PATH_INFO: `/v3/projects/2d8c3b0eee3e49f5b3cbf687cadc5ab5/users/ce93c02ee6b54339b3a74ae71a25769d/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:09.447603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022531da-8280-4c2f-9270-1ffb8d7c1c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8c3b0eee3e49f5b3cbf687cadc5ab5, user_id=ce93c02ee6b54339b3a74ae71a25769d, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:09.450292 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022531da-8280-4c2f-9270-1ffb8d7c1c9b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:09.540178 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1414/2851] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:09 2022] PUT /identity/v3/projects/2d8c3b0eee3e49f5b3cbf687cadc5ab5/users/ce93c02ee6b54339b3a74ae71a25769d/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:09.550759 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1789cb-cfa2-49f3-9462-e9e8b9a97547 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:09.551155 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1789cb-cfa2-49f3-9462-e9e8b9a97547 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:09.551435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1789cb-cfa2-49f3-9462-e9e8b9a97547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:09.580860 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-fd1789cb-cfa2-49f3-9462-e9e8b9a97547 None None] MFA Rules not processed for user `ce93c02ee6b54339b3a74ae71a25769d`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:09.582315 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-fd1789cb-cfa2-49f3-9462-e9e8b9a97547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:09.647200 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1438/2852] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:09.651722 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022531da-8280-4c2f-9270-1ffb8d7c1c9b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:09.722715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022531da-8280-4c2f-9270-1ffb8d7c1c9b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:09.728071 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5b559-d6e2-48c7-9c22-626350348b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:09.728717 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5b559-d6e2-48c7-9c22-626350348b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:09.729000 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5b559-d6e2-48c7-9c22-626350348b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:09.729274 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5b559-d6e2-48c7-9c22-626350348b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:09.729916 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5b559-d6e2-48c7-9c22-626350348b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:09.731870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5b559-d6e2-48c7-9c22-626350348b63 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:09.861579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1415/2853] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:26:09 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:09.865642 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1789cb-cfa2-49f3-9462-e9e8b9a97547 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:09.876591 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1789cb-cfa2-49f3-9462-e9e8b9a97547 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:09.934813 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c9b4f-5098-426c-97ec-10142cd6f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:09.938486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c9b4f-5098-426c-97ec-10142cd6f0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:09.938486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c9b4f-5098-426c-97ec-10142cd6f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:09.938486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c9b4f-5098-426c-97ec-10142cd6f0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:09.938486 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c9b4f-5098-426c-97ec-10142cd6f0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:09.938953 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c9b4f-5098-426c-97ec-10142cd6f0f9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:10.020207 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1439/2854] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:26:09 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:10.024466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5b559-d6e2-48c7-9c22-626350348b63 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:10.035428 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5b559-d6e2-48c7-9c22-626350348b63 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:10.040354 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8b7b-85eb-4a65-b183-927865661952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:10.040945 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8b7b-85eb-4a65-b183-927865661952 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:10.041225 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8b7b-85eb-4a65-b183-927865661952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:10.041501 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8b7b-85eb-4a65-b183-927865661952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:10.042174 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8b7b-85eb-4a65-b183-927865661952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:10.043836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8b7b-85eb-4a65-b183-927865661952 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:10.060162 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1416/2855] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:10.065245 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c9b4f-5098-426c-97ec-10142cd6f0f9 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:10.075346 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c9b4f-5098-426c-97ec-10142cd6f0f9 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:10.080033 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd0575-1d0d-4c16-866d-d60d419d3623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:10.080623 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd0575-1d0d-4c16-866d-d60d419d3623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:10.080949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd0575-1d0d-4c16-866d-d60d419d3623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:10.081435 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd0575-1d0d-4c16-866d-d60d419d3623 admin admin] PATH_INFO: `/v3/projects/6fa019c9ac1043538eee83cc3b23a3b8/users/e24651c92ed844f6939d1f9bad042d98/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:10.084506 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:10.097430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd0575-1d0d-4c16-866d-d60d419d3623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa019c9ac1043538eee83cc3b23a3b8, user_id=e24651c92ed844f6939d1f9bad042d98, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:10.100153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd0575-1d0d-4c16-866d-d60d419d3623 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:10.182142 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1440/2856] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:10 2022] PUT /identity/v3/projects/6fa019c9ac1043538eee83cc3b23a3b8/users/e24651c92ed844f6939d1f9bad042d98/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:10.186930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8b7b-85eb-4a65-b183-927865661952 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:10.197295 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8b7b-85eb-4a65-b183-927865661952 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:10.244892 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:10.254332 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ee634-120b-49ff-b130-b40347256c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:10.254978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee634-120b-49ff-b130-b40347256c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:10.259795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee634-120b-49ff-b130-b40347256c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:10.259795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee634-120b-49ff-b130-b40347256c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:10.259795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ee634-120b-49ff-b130-b40347256c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:10.259795 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ee634-120b-49ff-b130-b40347256c7d admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:10.268223 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1417/2857] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:10.272658 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd0575-1d0d-4c16-866d-d60d419d3623 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:10.283296 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd0575-1d0d-4c16-866d-d60d419d3623 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:10.287945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f9cef-fe91-488e-b916-b73f5cfa2a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:10.289379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f9cef-fe91-488e-b916-b73f5cfa2a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:10.289379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f9cef-fe91-488e-b916-b73f5cfa2a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:10.289379 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f9cef-fe91-488e-b916-b73f5cfa2a96 admin admin] PATH_INFO: `/v3/projects/6fa019c9ac1043538eee83cc3b23a3b8/users/e24651c92ed844f6939d1f9bad042d98/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:10.291193 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f9cef-fe91-488e-b916-b73f5cfa2a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa019c9ac1043538eee83cc3b23a3b8, user_id=e24651c92ed844f6939d1f9bad042d98, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:10.293824 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f9cef-fe91-488e-b916-b73f5cfa2a96 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:10.305041 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1441/2858] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:10 2022] PUT /identity/v3/projects/6fa019c9ac1043538eee83cc3b23a3b8/users/e24651c92ed844f6939d1f9bad042d98/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:10.316829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b4239-4857-414d-b891-61eb57947f8b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:10.317117 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b4239-4857-414d-b891-61eb57947f8b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:10.317396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b4239-4857-414d-b891-61eb57947f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:10.348308 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-ff7b4239-4857-414d-b891-61eb57947f8b None None] MFA Rules not processed for user `e24651c92ed844f6939d1f9bad042d98`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:10.349375 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ff7b4239-4857-414d-b891-61eb57947f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:10.426514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1418/2859] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:10.437487 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f9cef-fe91-488e-b916-b73f5cfa2a96 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:10.439353 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-9c4f9cef-fe91-488e-b916-b73f5cfa2a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:10.500641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f9cef-fe91-488e-b916-b73f5cfa2a96 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:10.504367 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b9e2-2515-4ac8-9dd3-bb1641a280a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:10.504966 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b9e2-2515-4ac8-9dd3-bb1641a280a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:10.505244 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b9e2-2515-4ac8-9dd3-bb1641a280a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:10.505514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b9e2-2515-4ac8-9dd3-bb1641a280a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:10.514974 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4b9e2-2515-4ac8-9dd3-bb1641a280a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:10.516430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4b9e2-2515-4ac8-9dd3-bb1641a280a1 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:10.526289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1442/2860] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:12.883822 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b4239-4857-414d-b891-61eb57947f8b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:12.885298 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-ff7b4239-4857-414d-b891-61eb57947f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:12.918491 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b4239-4857-414d-b891-61eb57947f8b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:12.922059 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46b1f-5f32-4269-9b9d-a91c391c6029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:12.922654 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46b1f-5f32-4269-9b9d-a91c391c6029 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:12.922930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46b1f-5f32-4269-9b9d-a91c391c6029 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:12.923198 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46b1f-5f32-4269-9b9d-a91c391c6029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:12.977690 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb46b1f-5f32-4269-9b9d-a91c391c6029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:12.979103 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb46b1f-5f32-4269-9b9d-a91c391c6029 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:12.987869 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1419/2861] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:17.941072 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b9e2-2515-4ac8-9dd3-bb1641a280a1 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:17.959683 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b9e2-2515-4ac8-9dd3-bb1641a280a1 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:17.963326 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885525fa-fdaa-4e4c-b08e-1962c71dff7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:17.963965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885525fa-fdaa-4e4c-b08e-1962c71dff7b service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:17.964253 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885525fa-fdaa-4e4c-b08e-1962c71dff7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:17.964531 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885525fa-fdaa-4e4c-b08e-1962c71dff7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:18.021631 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885525fa-fdaa-4e4c-b08e-1962c71dff7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:18.023045 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885525fa-fdaa-4e4c-b08e-1962c71dff7b service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:18.032613 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1443/2862] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:21.840483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46b1f-5f32-4269-9b9d-a91c391c6029 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:21.841978 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4bb46b1f-5f32-4269-9b9d-a91c391c6029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:21.899847 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46b1f-5f32-4269-9b9d-a91c391c6029 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:21.903457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f765134-ea88-4a91-985d-f467f99074f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:21.904138 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f765134-ea88-4a91-985d-f467f99074f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:21.904421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f765134-ea88-4a91-985d-f467f99074f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:21.904697 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f765134-ea88-4a91-985d-f467f99074f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:21.906454 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-4f765134-ea88-4a91-985d-f467f99074f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:21.912510 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:21.969212 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f765134-ea88-4a91-985d-f467f99074f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:21.970637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f765134-ea88-4a91-985d-f467f99074f6 service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:21.980349 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1420/2863] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:22.322780 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885525fa-fdaa-4e4c-b08e-1962c71dff7b service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:22.390130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885525fa-fdaa-4e4c-b08e-1962c71dff7b service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:22.394740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:22.395385 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:22.395695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:22.395978 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] PATH_INFO: `/v3/users/a1b904c080f746b08daf02a3e4b55d9d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:22.397112 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b904c080f746b08daf02a3e4b55d9d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:22.399028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:22.404384 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:22.614146 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b904c080f746b08daf02a3e4b55d9d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:22.614803 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b904c080f746b08daf02a3e4b55d9d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:22.708289 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b904c080f746b08daf02a3e4b55d9d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:22.709009 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b904c080f746b08daf02a3e4b55d9d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:22.717698 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b904c080f746b08daf02a3e4b55d9d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:22.736993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1444/2864] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:22 2022] DELETE /identity/v3/users/a1b904c080f746b08daf02a3e4b55d9d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:22.741457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8970f-98dc-404d-a4fb-65cee64cd2fb None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:22.747215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8970f-98dc-404d-a4fb-65cee64cd2fb None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:22.747215 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8970f-98dc-404d-a4fb-65cee64cd2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:22.762209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-74a8970f-98dc-404d-a4fb-65cee64cd2fb None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:22.763520 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-74a8970f-98dc-404d-a4fb-65cee64cd2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:22.824487 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1421/2865] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:22.834376 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:22.835965 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:22.899527 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96493983-65e4-4d86-aea4-dcb20a64ef5b admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:22.903469 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e905ae-d5df-4396-ae13-3b51c495b6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:22.904117 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e905ae-d5df-4396-ae13-3b51c495b6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:22.904403 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e905ae-d5df-4396-ae13-3b51c495b6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:22.905189 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e905ae-d5df-4396-ae13-3b51c495b6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:22.915107 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e905ae-d5df-4396-ae13-3b51c495b6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:22.916637 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e905ae-d5df-4396-ae13-3b51c495b6e3 service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:22.927010 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1445/2866] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:23.336208 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8970f-98dc-404d-a4fb-65cee64cd2fb None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:23.337642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-74a8970f-98dc-404d-a4fb-65cee64cd2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:23.352865 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8970f-98dc-404d-a4fb-65cee64cd2fb None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:23.358459 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:23.359229 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:23.359525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:23.360069 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] PATH_INFO: `/v3/projects/e17ea53b118b4ca9a258b45af17c910c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:23.361366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17ea53b118b4ca9a258b45af17c910c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:23.366244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:23.484969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17ea53b118b4ca9a258b45af17c910c', 'request_id': 'req-94c56410-a7cb-469e-84ab-02e50a01e497'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:23.491397 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17ea53b118b4ca9a258b45af17c910c', 'request_id': 'req-94c56410-a7cb-469e-84ab-02e50a01e497'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:23.577231 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17ea53b118b4ca9a258b45af17c910c', 'request_id': 'req-94c56410-a7cb-469e-84ab-02e50a01e497'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:23.589497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] The token cache is being invalidate because project e17ea53b118b4ca9a258b45af17c910c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:23.589791 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:23.590442 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:23.592809 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1422/2867] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:23 2022] DELETE /identity/v3/projects/e17ea53b118b4ca9a258b45af17c910c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:23.596583 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e905ae-d5df-4396-ae13-3b51c495b6e3 service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:23.606372 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e905ae-d5df-4396-ae13-3b51c495b6e3 service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:23.676620 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:23.677256 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:23.677541 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:23.677815 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] PATH_INFO: `/v3/users/ce93c02ee6b54339b3a74ae71a25769d` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:23.678939 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce93c02ee6b54339b3a74ae71a25769d)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:23.680949 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:23.775853 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:23.929473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce93c02ee6b54339b3a74ae71a25769d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:23.930213 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce93c02ee6b54339b3a74ae71a25769d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:23.996861 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce93c02ee6b54339b3a74ae71a25769d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:23.997641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce93c02ee6b54339b3a74ae71a25769d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:24.009380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce93c02ee6b54339b3a74ae71a25769d'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:24.029754 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1446/2868] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:23 2022] DELETE /identity/v3/users/ce93c02ee6b54339b3a74ae71a25769d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:24.751494 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:24.754575 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:24.779001 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c56410-a7cb-469e-84ab-02e50a01e497 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:24.810957 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:24.850153 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:24.851099 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:24.851384 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:24.851687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] PATH_INFO: `/v3/projects/2d8c3b0eee3e49f5b3cbf687cadc5ab5` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:24.852820 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8c3b0eee3e49f5b3cbf687cadc5ab5)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:24.854721 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:25.000884 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8c3b0eee3e49f5b3cbf687cadc5ab5', 'request_id': 'req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.007692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8c3b0eee3e49f5b3cbf687cadc5ab5', 'request_id': 'req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.096650 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8c3b0eee3e49f5b3cbf687cadc5ab5', 'request_id': 'req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.111997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] The token cache is being invalidate because project 2d8c3b0eee3e49f5b3cbf687cadc5ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:25.111997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.111997 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.115678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1423/2869] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:24 2022] DELETE /identity/v3/projects/2d8c3b0eee3e49f5b3cbf687cadc5ab5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:25.118138 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:25.119809 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:25.136864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a828046-f933-405b-8d64-b897ca3a8077 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:25.206501 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:25.207170 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:25.207456 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:25.207791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] PATH_INFO: `/v3/users/e24651c92ed844f6939d1f9bad042d98` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:25.209027 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24651c92ed844f6939d1f9bad042d98)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:25.210948 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:25.427695 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24651c92ed844f6939d1f9bad042d98'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.428494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24651c92ed844f6939d1f9bad042d98'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.490593 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24651c92ed844f6939d1f9bad042d98'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.491304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24651c92ed844f6939d1f9bad042d98'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.499635 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-0e25f406-830d-4005-a627-b28a54c73861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24651c92ed844f6939d1f9bad042d98'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:25.518717 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1447/2870] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:25 2022] DELETE /identity/v3/users/e24651c92ed844f6939d1f9bad042d98 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:25.934100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:25.935804 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:25.948474 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4cf1-0874-4545-9986-8ac0d2c7c7d3 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:26.008701 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:26.009497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.009807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.010052 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] PATH_INFO: `/v3/projects/6fa019c9ac1043538eee83cc3b23a3b8` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.011319 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa019c9ac1043538eee83cc3b23a3b8)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:26.013290 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:26.136626 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa019c9ac1043538eee83cc3b23a3b8', 'request_id': 'req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:26.143364 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa019c9ac1043538eee83cc3b23a3b8', 'request_id': 'req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:26.147035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:26.210909 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa019c9ac1043538eee83cc3b23a3b8', 'request_id': 'req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:26.221796 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] The token cache is being invalidate because project 6fa019c9ac1043538eee83cc3b23a3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:26.222085 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:26.224642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-cded8d94-0d82-48ca-8a84-c295c1ef7fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:26.224642 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1424/2871] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:25 2022] DELETE /identity/v3/projects/6fa019c9ac1043538eee83cc3b23a3b8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:26.231128 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c78dbf-0d1d-4a60-b644-1801df02c254 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.231674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c78dbf-0d1d-4a60-b644-1801df02c254 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.231801 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c78dbf-0d1d-4a60-b644-1801df02c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.252383 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-f2c78dbf-0d1d-4a60-b644-1801df02c254 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:26.253615 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-f2c78dbf-0d1d-4a60-b644-1801df02c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:26.273118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:26.315441 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1448/2872] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:26.323782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481dcb9-ae7f-47bb-9a67-943b765d9d05 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.324076 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481dcb9-ae7f-47bb-9a67-943b765d9d05 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.324394 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481dcb9-ae7f-47bb-9a67-943b765d9d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.345579 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-0481dcb9-ae7f-47bb-9a67-943b765d9d05 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:26.346817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-0481dcb9-ae7f-47bb-9a67-943b765d9d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:26.354870 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1425/2873] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:26.359718 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c78dbf-0d1d-4a60-b644-1801df02c254 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:26.369432 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c78dbf-0d1d-4a60-b644-1801df02c254 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:26.374676 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08109b-7aaa-49c2-b8e4-93a295549128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:26.375267 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08109b-7aaa-49c2-b8e4-93a295549128 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.375544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08109b-7aaa-49c2-b8e4-93a295549128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.375846 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08109b-7aaa-49c2-b8e4-93a295549128 admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.376494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08109b-7aaa-49c2-b8e4-93a295549128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:26:26.376797 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08109b-7aaa-49c2-b8e4-93a295549128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:26.378424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08109b-7aaa-49c2-b8e4-93a295549128 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:26.390019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1449/2874] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:26:26.394513 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481dcb9-ae7f-47bb-9a67-943b765d9d05 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:26.403783 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481dcb9-ae7f-47bb-9a67-943b765d9d05 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:26.412146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802cfd7-5cb0-48bd-982f-eaaeb9a32685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:26.412146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802cfd7-5cb0-48bd-982f-eaaeb9a32685 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.412146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802cfd7-5cb0-48bd-982f-eaaeb9a32685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.412146 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802cfd7-5cb0-48bd-982f-eaaeb9a32685 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.412565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802cfd7-5cb0-48bd-982f-eaaeb9a32685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:26.412565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802cfd7-5cb0-48bd-982f-eaaeb9a32685 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:26.512552 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1426/2875] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:26:26 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:26.516764 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08109b-7aaa-49c2-b8e4-93a295549128 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:26.526685 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08109b-7aaa-49c2-b8e4-93a295549128 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:26.583963 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd629ce4-2e1a-4804-a105-c5fdb36a461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:26.584567 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd629ce4-2e1a-4804-a105-c5fdb36a461d admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.584849 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd629ce4-2e1a-4804-a105-c5fdb36a461d admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.585157 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd629ce4-2e1a-4804-a105-c5fdb36a461d admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.585791 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd629ce4-2e1a-4804-a105-c5fdb36a461d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:26.587697 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd629ce4-2e1a-4804-a105-c5fdb36a461d admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:26.685680 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1450/2876] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:26:26 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:26:26.690610 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802cfd7-5cb0-48bd-982f-eaaeb9a32685 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:26.701041 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802cfd7-5cb0-48bd-982f-eaaeb9a32685 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:26.706594 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd2826-04f8-49db-a339-67477af1083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:26.707230 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd2826-04f8-49db-a339-67477af1083a admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.707464 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd2826-04f8-49db-a339-67477af1083a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.707784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd2826-04f8-49db-a339-67477af1083a admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.708422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd2826-04f8-49db-a339-67477af1083a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:26.710009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd2826-04f8-49db-a339-67477af1083a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:26.720565 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1427/2877] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:26.724665 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd629ce4-2e1a-4804-a105-c5fdb36a461d admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:26.734609 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd629ce4-2e1a-4804-a105-c5fdb36a461d admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:26.739218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5661fb2-45b9-43dc-8073-9fc7cb1bf179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:26.739836 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5661fb2-45b9-43dc-8073-9fc7cb1bf179 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.740118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5661fb2-45b9-43dc-8073-9fc7cb1bf179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.740390 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5661fb2-45b9-43dc-8073-9fc7cb1bf179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.741019 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5661fb2-45b9-43dc-8073-9fc7cb1bf179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:26.742578 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5661fb2-45b9-43dc-8073-9fc7cb1bf179 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:26.759251 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1451/2878] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:26.763451 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd2826-04f8-49db-a339-67477af1083a admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:26.774441 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd2826-04f8-49db-a339-67477af1083a admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:26.779408 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0563f1f-1e0d-4dbe-9fa7-f130ea8b3940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:26.780194 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0563f1f-1e0d-4dbe-9fa7-f130ea8b3940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.780457 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0563f1f-1e0d-4dbe-9fa7-f130ea8b3940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.780761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0563f1f-1e0d-4dbe-9fa7-f130ea8b3940 admin admin] PATH_INFO: `/v3/projects/224a6de2ae86417f815f95fe035b1493/users/ae58929bf3dc472fa003107966290f6b/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.796170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0563f1f-1e0d-4dbe-9fa7-f130ea8b3940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224a6de2ae86417f815f95fe035b1493, user_id=ae58929bf3dc472fa003107966290f6b, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:26.798807 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0563f1f-1e0d-4dbe-9fa7-f130ea8b3940 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:26.892624 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1428/2879] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:26 2022] PUT /identity/v3/projects/224a6de2ae86417f815f95fe035b1493/users/ae58929bf3dc472fa003107966290f6b/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:26.962713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28faf43-6a44-4d92-9f9d-00115a5de432 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:26.962910 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28faf43-6a44-4d92-9f9d-00115a5de432 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:26.963178 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28faf43-6a44-4d92-9f9d-00115a5de432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:26.993206 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-c28faf43-6a44-4d92-9f9d-00115a5de432 None None] MFA Rules not processed for user `ae58929bf3dc472fa003107966290f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:26.994419 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c28faf43-6a44-4d92-9f9d-00115a5de432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:27.062574 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1452/2880] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:27.067123 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0563f1f-1e0d-4dbe-9fa7-f130ea8b3940 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:27.132691 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0563f1f-1e0d-4dbe-9fa7-f130ea8b3940 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:27.137460 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeebf7-5f39-4ffa-ae09-2c562f39c179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:27.138073 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeebf7-5f39-4ffa-ae09-2c562f39c179 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:27.138356 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeebf7-5f39-4ffa-ae09-2c562f39c179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:27.138741 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeebf7-5f39-4ffa-ae09-2c562f39c179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:27.139836 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeebf7-5f39-4ffa-ae09-2c562f39c179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:27.141740 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeebf7-5f39-4ffa-ae09-2c562f39c179 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:27.224843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1429/2881] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:26:27 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:27.228943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28faf43-6a44-4d92-9f9d-00115a5de432 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:27.240566 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28faf43-6a44-4d92-9f9d-00115a5de432 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:27.258449 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:27.300739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929c29-bd9a-47f8-ae73-f6feb88b7e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:27.301360 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929c29-bd9a-47f8-ae73-f6feb88b7e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:27.301641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929c29-bd9a-47f8-ae73-f6feb88b7e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:27.301915 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929c29-bd9a-47f8-ae73-f6feb88b7e3f admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:27.302563 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7929c29-bd9a-47f8-ae73-f6feb88b7e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:27.304498 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7929c29-bd9a-47f8-ae73-f6feb88b7e3f admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:27.382808 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1453/2882] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:26:27 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:27.387047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeebf7-5f39-4ffa-ae09-2c562f39c179 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:27.397767 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeebf7-5f39-4ffa-ae09-2c562f39c179 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:27.402606 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d4c2a-dd3d-49d3-bcf8-687ecfe7d539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:27.403211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d4c2a-dd3d-49d3-bcf8-687ecfe7d539 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:27.403543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d4c2a-dd3d-49d3-bcf8-687ecfe7d539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:27.405084 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d4c2a-dd3d-49d3-bcf8-687ecfe7d539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:27.406436 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d4c2a-dd3d-49d3-bcf8-687ecfe7d539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:27.408244 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d4c2a-dd3d-49d3-bcf8-687ecfe7d539 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:27.421145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1430/2883] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:27.427343 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929c29-bd9a-47f8-ae73-f6feb88b7e3f admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:27.449747 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929c29-bd9a-47f8-ae73-f6feb88b7e3f admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:27.462587 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc6fb2-352b-4c7f-aa7a-e7c3f0c8d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:27.463275 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6fb2-352b-4c7f-aa7a-e7c3f0c8d540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:27.463554 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6fb2-352b-4c7f-aa7a-e7c3f0c8d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:27.463896 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6fb2-352b-4c7f-aa7a-e7c3f0c8d540 admin admin] PATH_INFO: `/v3/projects/f98aed78ff8d45efb07af76036e5c91e/users/8f730320267e451b91fa4d4b38529ed9/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:27.494099 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc6fb2-352b-4c7f-aa7a-e7c3f0c8d540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98aed78ff8d45efb07af76036e5c91e, user_id=8f730320267e451b91fa4d4b38529ed9, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:27.498260 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc6fb2-352b-4c7f-aa7a-e7c3f0c8d540 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:27.593013 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1454/2884] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:27 2022] PUT /identity/v3/projects/f98aed78ff8d45efb07af76036e5c91e/users/8f730320267e451b91fa4d4b38529ed9/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:27.598211 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d4c2a-dd3d-49d3-bcf8-687ecfe7d539 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:27.614358 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d4c2a-dd3d-49d3-bcf8-687ecfe7d539 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:27.689682 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:27.697497 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8431e0-7a8a-4827-afe7-9d2785398ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:27.698383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8431e0-7a8a-4827-afe7-9d2785398ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:27.698732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8431e0-7a8a-4827-afe7-9d2785398ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:27.699689 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8431e0-7a8a-4827-afe7-9d2785398ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:27.699881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8431e0-7a8a-4827-afe7-9d2785398ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:27.703028 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8431e0-7a8a-4827-afe7-9d2785398ef6 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:27.719758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1431/2885] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:27.722753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc6fb2-352b-4c7f-aa7a-e7c3f0c8d540 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:27.734887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc6fb2-352b-4c7f-aa7a-e7c3f0c8d540 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:27.742952 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e750b-8934-481b-b8dc-af3769dc862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:27.744729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e750b-8934-481b-b8dc-af3769dc862c admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:27.745109 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e750b-8934-481b-b8dc-af3769dc862c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:27.745641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e750b-8934-481b-b8dc-af3769dc862c admin admin] PATH_INFO: `/v3/projects/f98aed78ff8d45efb07af76036e5c91e/users/8f730320267e451b91fa4d4b38529ed9/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:27.749436 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e750b-8934-481b-b8dc-af3769dc862c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98aed78ff8d45efb07af76036e5c91e, user_id=8f730320267e451b91fa4d4b38529ed9, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:27.752787 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e750b-8934-481b-b8dc-af3769dc862c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:27.776287 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1455/2886] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:27 2022] PUT /identity/v3/projects/f98aed78ff8d45efb07af76036e5c91e/users/8f730320267e451b91fa4d4b38529ed9/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:27.778959 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba28132-1fd2-4cd6-aed1-1e45315d797b None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:27.780064 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba28132-1fd2-4cd6-aed1-1e45315d797b None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:27.780632 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba28132-1fd2-4cd6-aed1-1e45315d797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:27.816797 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-2ba28132-1fd2-4cd6-aed1-1e45315d797b None None] MFA Rules not processed for user `8f730320267e451b91fa4d4b38529ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:27.818166 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-2ba28132-1fd2-4cd6-aed1-1e45315d797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:27.903114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1432/2887] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:27.914932 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e750b-8934-481b-b8dc-af3769dc862c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:27.916769 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-6c3e750b-8934-481b-b8dc-af3769dc862c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:27.992869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e750b-8934-481b-b8dc-af3769dc862c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:27.997261 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3728f8-1edb-45e6-a8dc-852b7c4c327b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:27.997916 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3728f8-1edb-45e6-a8dc-852b7c4c327b service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:27.998408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3728f8-1edb-45e6-a8dc-852b7c4c327b service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:27.999011 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3728f8-1edb-45e6-a8dc-852b7c4c327b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:28.012427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3728f8-1edb-45e6-a8dc-852b7c4c327b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:28.012427 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3728f8-1edb-45e6-a8dc-852b7c4c327b service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:28.025796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1456/2888] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:28.136881 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba28132-1fd2-4cd6-aed1-1e45315d797b None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:28.146576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba28132-1fd2-4cd6-aed1-1e45315d797b None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:28.150236 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6505-d47e-4e3d-9afe-9d21f0d123c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:28.150911 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6505-d47e-4e3d-9afe-9d21f0d123c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:28.151262 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6505-d47e-4e3d-9afe-9d21f0d123c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:28.151604 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6505-d47e-4e3d-9afe-9d21f0d123c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:28.211704 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6505-d47e-4e3d-9afe-9d21f0d123c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:28.213142 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6505-d47e-4e3d-9afe-9d21f0d123c6 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:28.222467 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1433/2889] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:31.477066 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3728f8-1edb-45e6-a8dc-852b7c4c327b service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:31.540713 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3728f8-1edb-45e6-a8dc-852b7c4c327b service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:31.545381 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:31.546096 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:31.546424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:31.546740 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] PATH_INFO: `/v3/users/ae58929bf3dc472fa003107966290f6b` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:31.547970 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae58929bf3dc472fa003107966290f6b)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:31.550153 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:31.566369 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:31.764247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae58929bf3dc472fa003107966290f6b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:31.764826 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae58929bf3dc472fa003107966290f6b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:31.833646 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae58929bf3dc472fa003107966290f6b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:31.834303 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae58929bf3dc472fa003107966290f6b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:31.842056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae58929bf3dc472fa003107966290f6b'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:31.860026 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1457/2890] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:31 2022] DELETE /identity/v3/users/ae58929bf3dc472fa003107966290f6b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:31.864548 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b0771-5a38-4483-be8a-15cb6e4e1dec None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:31.865032 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b0771-5a38-4483-be8a-15cb6e4e1dec None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:31.865148 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b0771-5a38-4483-be8a-15cb6e4e1dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:31.884633 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-e42b0771-5a38-4483-be8a-15cb6e4e1dec None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:31.885829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e42b0771-5a38-4483-be8a-15cb6e4e1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:31.944186 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1434/2891] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:31.953947 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:31.955368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:32.012753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b93b5-5191-4bd5-af44-6069788f5778 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:32.016431 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6341c-b77e-4fb8-a47f-d835d13e673c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:32.016980 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6341c-b77e-4fb8-a47f-d835d13e673c service neutron] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:32.017269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6341c-b77e-4fb8-a47f-d835d13e673c service neutron] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:32.017544 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6341c-b77e-4fb8-a47f-d835d13e673c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:32.026459 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6341c-b77e-4fb8-a47f-d835d13e673c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:32.027900 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6341c-b77e-4fb8-a47f-d835d13e673c service neutron] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:32.037832 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1458/2892] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:32.458986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b0771-5a38-4483-be8a-15cb6e4e1dec None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:32.460509 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-e42b0771-5a38-4483-be8a-15cb6e4e1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:32.473047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b0771-5a38-4483-be8a-15cb6e4e1dec None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:32.477751 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:32.478383 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:32.478664 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:32.478939 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] PATH_INFO: `/v3/projects/224a6de2ae86417f815f95fe035b1493` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:32.480125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224a6de2ae86417f815f95fe035b1493)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:32.482011 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:32.494100 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:32.601379 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224a6de2ae86417f815f95fe035b1493', 'request_id': 'req-97a40acb-d28b-48da-841d-20c6aebf3af2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:32.607412 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224a6de2ae86417f815f95fe035b1493', 'request_id': 'req-97a40acb-d28b-48da-841d-20c6aebf3af2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:32.682559 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224a6de2ae86417f815f95fe035b1493', 'request_id': 'req-97a40acb-d28b-48da-841d-20c6aebf3af2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:32.693677 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] The token cache is being invalidate because project 224a6de2ae86417f815f95fe035b1493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:32.694054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:32.694849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:32.696377 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1435/2893] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:32 2022] DELETE /identity/v3/projects/224a6de2ae86417f815f95fe035b1493 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:32.700605 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6341c-b77e-4fb8-a47f-d835d13e673c service neutron] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:32.710517 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6341c-b77e-4fb8-a47f-d835d13e673c service neutron] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:32.767202 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:32.767864 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:32.768150 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:32.768428 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] PATH_INFO: `/v3/users/8f730320267e451b91fa4d4b38529ed9` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:32.769545 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f730320267e451b91fa4d4b38529ed9)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:32.771434 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:32.932005 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:32.938918 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f730320267e451b91fa4d4b38529ed9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:32.939735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f730320267e451b91fa4d4b38529ed9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:33.017324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f730320267e451b91fa4d4b38529ed9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:33.017931 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f730320267e451b91fa4d4b38529ed9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:33.025463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-458491f3-3119-4c9a-95e0-fd4ce0bda42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f730320267e451b91fa4d4b38529ed9'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:33.042496 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1459/2894] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:32 2022] DELETE /identity/v3/users/8f730320267e451b91fa4d4b38529ed9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:33.421253 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:33.422696 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:33.436669 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40acb-d28b-48da-841d-20c6aebf3af2 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:33.496139 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:33.496768 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:33.497048 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:33.497317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] PATH_INFO: `/v3/projects/f98aed78ff8d45efb07af76036e5c91e` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:33.498423 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98aed78ff8d45efb07af76036e5c91e)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:33.500845 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:33.608545 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98aed78ff8d45efb07af76036e5c91e', 'request_id': 'req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:33.615434 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98aed78ff8d45efb07af76036e5c91e', 'request_id': 'req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:33.694144 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98aed78ff8d45efb07af76036e5c91e', 'request_id': 'req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:33.705519 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] The token cache is being invalidate because project f98aed78ff8d45efb07af76036e5c91e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:33.705735 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:33.706800 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-6d59eafc-64f1-4685-866c-79e8e0dbf0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:33.708360 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1436/2895] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:33 2022] DELETE /identity/v3/projects/f98aed78ff8d45efb07af76036e5c91e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:33.713502 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec9b9-074b-456c-96b0-1edb6e8c84b3 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:33.713972 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec9b9-074b-456c-96b0-1edb6e8c84b3 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:33.714067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec9b9-074b-456c-96b0-1edb6e8c84b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:33.734933 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-03eec9b9-074b-456c-96b0-1edb6e8c84b3 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:33.736237 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-03eec9b9-074b-456c-96b0-1edb6e8c84b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:33.795079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1460/2896] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:33.803055 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58560b-f8ce-4116-974d-ea0ab5a6bed5 None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:33.803333 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58560b-f8ce-4116-974d-ea0ab5a6bed5 None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:33.803603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58560b-f8ce-4116-974d-ea0ab5a6bed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:33.822825 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-8d58560b-f8ce-4116-974d-ea0ab5a6bed5 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:33.824089 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-8d58560b-f8ce-4116-974d-ea0ab5a6bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:33.832585 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1437/2897] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:33.836869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec9b9-074b-456c-96b0-1edb6e8c84b3 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:33.847143 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec9b9-074b-456c-96b0-1edb6e8c84b3 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:33.851702 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6c0ac-495f-4330-be19-5213ed5dc19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:33.852299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6c0ac-495f-4330-be19-5213ed5dc19a admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:33.852582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6c0ac-495f-4330-be19-5213ed5dc19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:33.852856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6c0ac-495f-4330-be19-5213ed5dc19a admin admin] PATH_INFO: `/v3/domains` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:33.853494 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6c0ac-495f-4330-be19-5213ed5dc19a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 12:26:33.853799 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6c0ac-495f-4330-be19-5213ed5dc19a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:33.855373 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6c0ac-495f-4330-be19-5213ed5dc19a admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:33.867347 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1461/2898] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 12:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 12:26:33.871855 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58560b-f8ce-4116-974d-ea0ab5a6bed5 None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:33.880989 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58560b-f8ce-4116-974d-ea0ab5a6bed5 None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:33.885525 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eeadb5-7547-4c87-a7e4-5b9e0d87a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:33.886114 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eeadb5-7547-4c87-a7e4-5b9e0d87a4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:33.886391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eeadb5-7547-4c87-a7e4-5b9e0d87a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:33.886678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eeadb5-7547-4c87-a7e4-5b9e0d87a4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:33.887322 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eeadb5-7547-4c87-a7e4-5b9e0d87a4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:33.889232 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eeadb5-7547-4c87-a7e4-5b9e0d87a4b7 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:33.978266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1438/2899] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:26:33 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:33.982610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6c0ac-495f-4330-be19-5213ed5dc19a admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:33.992546 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6c0ac-495f-4330-be19-5213ed5dc19a admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:34.048899 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804beb0-1703-4926-bfa8-30cf4f584ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:34.049509 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804beb0-1703-4926-bfa8-30cf4f584ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.049796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804beb0-1703-4926-bfa8-30cf4f584ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.050081 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804beb0-1703-4926-bfa8-30cf4f584ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.050721 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804beb0-1703-4926-bfa8-30cf4f584ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:34.052668 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804beb0-1703-4926-bfa8-30cf4f584ddc admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:34.137744 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1462/2900] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:26:33 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:34.142616 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eeadb5-7547-4c87-a7e4-5b9e0d87a4b7 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:34.148195 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:34.153510 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eeadb5-7547-4c87-a7e4-5b9e0d87a4b7 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:34.158250 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c11390-fa9f-410d-8500-a0b47eae0731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:34.158854 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c11390-fa9f-410d-8500-a0b47eae0731 admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.159131 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c11390-fa9f-410d-8500-a0b47eae0731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.159399 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c11390-fa9f-410d-8500-a0b47eae0731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.160062 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c11390-fa9f-410d-8500-a0b47eae0731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:34.161742 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c11390-fa9f-410d-8500-a0b47eae0731 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:34.171772 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1439/2901] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:34.175762 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804beb0-1703-4926-bfa8-30cf4f584ddc admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:34.185924 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804beb0-1703-4926-bfa8-30cf4f584ddc admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:34.190986 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c987e30-5e2e-42e4-9396-a42442382fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:34.191582 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c987e30-5e2e-42e4-9396-a42442382fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.191897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c987e30-5e2e-42e4-9396-a42442382fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.192172 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c987e30-5e2e-42e4-9396-a42442382fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.192843 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c987e30-5e2e-42e4-9396-a42442382fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:34.194410 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c987e30-5e2e-42e4-9396-a42442382fb6 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:34.206442 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1463/2902] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:34.215426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c11390-fa9f-410d-8500-a0b47eae0731 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:34.225986 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c11390-fa9f-410d-8500-a0b47eae0731 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:34.230928 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913348-989c-4300-9fe1-9f026ecdebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:34.231794 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913348-989c-4300-9fe1-9f026ecdebfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.232444 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913348-989c-4300-9fe1-9f026ecdebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.232834 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913348-989c-4300-9fe1-9f026ecdebfa admin admin] PATH_INFO: `/v3/projects/d2b97fb1eb7d499f946a5c29559d3e08/users/ea778ebb7b2f4a2a9fb5cb2d04533b6a/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.247924 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913348-989c-4300-9fe1-9f026ecdebfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b97fb1eb7d499f946a5c29559d3e08, user_id=ea778ebb7b2f4a2a9fb5cb2d04533b6a, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:34.251317 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913348-989c-4300-9fe1-9f026ecdebfa admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:34.325433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1440/2903] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:34 2022] PUT /identity/v3/projects/d2b97fb1eb7d499f946a5c29559d3e08/users/ea778ebb7b2f4a2a9fb5cb2d04533b6a/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:34.338079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dc6d6-10a4-4887-8336-7c7ac2200985 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.338365 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dc6d6-10a4-4887-8336-7c7ac2200985 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.338645 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dc6d6-10a4-4887-8336-7c7ac2200985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.366734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-c59dc6d6-10a4-4887-8336-7c7ac2200985 None None] MFA Rules not processed for user `ea778ebb7b2f4a2a9fb5cb2d04533b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:34.368075 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-c59dc6d6-10a4-4887-8336-7c7ac2200985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:34.378514 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:34.433368 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1464/2904] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:34.438544 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913348-989c-4300-9fe1-9f026ecdebfa admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:34.503718 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913348-989c-4300-9fe1-9f026ecdebfa admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:34.508426 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928af036-3969-44e6-983a-a4eb030f7c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:34.512617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928af036-3969-44e6-983a-a4eb030f7c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.512617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928af036-3969-44e6-983a-a4eb030f7c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.512617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928af036-3969-44e6-983a-a4eb030f7c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.512617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928af036-3969-44e6-983a-a4eb030f7c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:34.512617 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928af036-3969-44e6-983a-a4eb030f7c35 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:34.595932 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1441/2905] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:26:34 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:26:34.600293 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dc6d6-10a4-4887-8336-7c7ac2200985 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:34.610976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dc6d6-10a4-4887-8336-7c7ac2200985 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:34.668335 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24a2e9-7a82-490c-9e32-21ae1e0decab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:34.668945 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24a2e9-7a82-490c-9e32-21ae1e0decab admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.669297 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24a2e9-7a82-490c-9e32-21ae1e0decab admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.669499 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24a2e9-7a82-490c-9e32-21ae1e0decab admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.670125 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24a2e9-7a82-490c-9e32-21ae1e0decab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:34.672042 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24a2e9-7a82-490c-9e32-21ae1e0decab admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:34.843121 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1465/2906] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:26:34 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:26:34.848380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928af036-3969-44e6-983a-a4eb030f7c35 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:34.858748 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928af036-3969-44e6-983a-a4eb030f7c35 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:34.863326 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcd3d5-e875-46d2-ad21-0fef8bd74dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:34.864060 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcd3d5-e875-46d2-ad21-0fef8bd74dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.864344 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcd3d5-e875-46d2-ad21-0fef8bd74dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.864618 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcd3d5-e875-46d2-ad21-0fef8bd74dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.865430 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcd3d5-e875-46d2-ad21-0fef8bd74dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:34.866851 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcd3d5-e875-46d2-ad21-0fef8bd74dbb admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:34.878422 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1442/2907] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:34.882607 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24a2e9-7a82-490c-9e32-21ae1e0decab admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:34.893457 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24a2e9-7a82-490c-9e32-21ae1e0decab admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:34.898037 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb8c60-1c64-4727-83e7-be4c6d249969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:34.898651 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8c60-1c64-4727-83e7-be4c6d249969 admin admin] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.898938 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8c60-1c64-4727-83e7-be4c6d249969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.899214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8c60-1c64-4727-83e7-be4c6d249969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.899882 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb8c60-1c64-4727-83e7-be4c6d249969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:34.901463 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb8c60-1c64-4727-83e7-be4c6d249969 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:34.912454 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1466/2908] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:34.916782 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcd3d5-e875-46d2-ad21-0fef8bd74dbb admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:34.927576 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcd3d5-e875-46d2-ad21-0fef8bd74dbb admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:34.932180 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d64ad2-d44e-42f0-9b05-78ec4df4d292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:34.932839 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64ad2-d44e-42f0-9b05-78ec4df4d292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:34.933112 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64ad2-d44e-42f0-9b05-78ec4df4d292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:34.933387 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64ad2-d44e-42f0-9b05-78ec4df4d292 admin admin] PATH_INFO: `/v3/projects/5d221032d8444dd3bc693227bb2ebcf5/users/1e608b83a87245bd971ad4c67469bb95/roles/df79e12324de40afbb353b95363811cc` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:34.948687 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d64ad2-d44e-42f0-9b05-78ec4df4d292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d221032d8444dd3bc693227bb2ebcf5, user_id=1e608b83a87245bd971ad4c67469bb95, role_id=df79e12324de40afbb353b95363811cc)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:34.951340 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d64ad2-d44e-42f0-9b05-78ec4df4d292 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:35.023788 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1443/2909] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:34 2022] PUT /identity/v3/projects/5d221032d8444dd3bc693227bb2ebcf5/users/1e608b83a87245bd971ad4c67469bb95/roles/df79e12324de40afbb353b95363811cc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:35.034731 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b141f8-918b-42b8-a3d7-76ad0c24d2a8 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:35.035004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b141f8-918b-42b8-a3d7-76ad0c24d2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:35.035276 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b141f8-918b-42b8-a3d7-76ad0c24d2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:35.064415 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-b0b141f8-918b-42b8-a3d7-76ad0c24d2a8 None None] MFA Rules not processed for user `1e608b83a87245bd971ad4c67469bb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:35.065641 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-b0b141f8-918b-42b8-a3d7-76ad0c24d2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:35.131079 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1467/2910] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:35.135732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d64ad2-d44e-42f0-9b05-78ec4df4d292 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:35.198141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d64ad2-d44e-42f0-9b05-78ec4df4d292 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:35.202907 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9319b2-fb98-409f-8795-bb9a3997cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:35.203514 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9319b2-fb98-409f-8795-bb9a3997cef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:35.203833 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9319b2-fb98-409f-8795-bb9a3997cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:35.204665 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9319b2-fb98-409f-8795-bb9a3997cef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:35.205289 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9319b2-fb98-409f-8795-bb9a3997cef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:35.207433 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9319b2-fb98-409f-8795-bb9a3997cef3 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:35.299352 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1444/2911] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 12:26:35 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 12:26:35.303576 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b141f8-918b-42b8-a3d7-76ad0c24d2a8 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:35.314778 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b141f8-918b-42b8-a3d7-76ad0c24d2a8 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:35.330943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:35.371201 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8dbd4-a49f-482c-9fbe-9843c7892320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:35.371834 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8dbd4-a49f-482c-9fbe-9843c7892320 admin admin] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:35.372118 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8dbd4-a49f-482c-9fbe-9843c7892320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:35.372482 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8dbd4-a49f-482c-9fbe-9843c7892320 admin admin] PATH_INFO: `/v3/users` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:35.373174 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8dbd4-a49f-482c-9fbe-9843c7892320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:35.375056 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8dbd4-a49f-482c-9fbe-9843c7892320 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:35.441493 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1468/2912] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 12:26:35 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 12:26:35.446043 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9319b2-fb98-409f-8795-bb9a3997cef3 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:35.451749 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:35.458125 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9319b2-fb98-409f-8795-bb9a3997cef3 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:35.462923 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4f791-102d-4811-9c72-18722a3ae11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:35.463543 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4f791-102d-4811-9c72-18722a3ae11b admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:35.463891 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4f791-102d-4811-9c72-18722a3ae11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:35.464206 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4f791-102d-4811-9c72-18722a3ae11b admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:35.467977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4f791-102d-4811-9c72-18722a3ae11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:35.467977 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4f791-102d-4811-9c72-18722a3ae11b admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:35.477843 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1445/2913] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:35.482520 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8dbd4-a49f-482c-9fbe-9843c7892320 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:35.493286 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8dbd4-a49f-482c-9fbe-9843c7892320 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:35.497976 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf83bc-f04d-408a-a28f-d2ad3ff929f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:35.498648 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf83bc-f04d-408a-a28f-d2ad3ff929f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:35.498930 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf83bc-f04d-408a-a28f-d2ad3ff929f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:35.499203 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf83bc-f04d-408a-a28f-d2ad3ff929f9 admin admin] PATH_INFO: `/v3/projects/23d5b0bd661748cba3fe639731110c46/users/83e179f55f954278ad99631ad9d1cf4c/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:35.515022 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf83bc-f04d-408a-a28f-d2ad3ff929f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d5b0bd661748cba3fe639731110c46, user_id=83e179f55f954278ad99631ad9d1cf4c, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:35.518312 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf83bc-f04d-408a-a28f-d2ad3ff929f9 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:35.589193 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1469/2914] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:35 2022] PUT /identity/v3/projects/23d5b0bd661748cba3fe639731110c46/users/83e179f55f954278ad99631ad9d1cf4c/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:35.593259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4f791-102d-4811-9c72-18722a3ae11b admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:35.604300 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4f791-102d-4811-9c72-18722a3ae11b admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:35.662714 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d3140-b491-43f7-b409-6ee5b16f418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:35.663831 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d3140-b491-43f7-b409-6ee5b16f418a admin admin] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:35.664111 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d3140-b491-43f7-b409-6ee5b16f418a admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:35.664380 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d3140-b491-43f7-b409-6ee5b16f418a admin admin] PATH_INFO: `/v3/roles` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:35.665054 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d3140-b491-43f7-b409-6ee5b16f418a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:35.666608 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d3140-b491-43f7-b409-6ee5b16f418a admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:35.677622 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1446/2915] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 12:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 12:26:35.682350 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf83bc-f04d-408a-a28f-d2ad3ff929f9 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:35.693983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf83bc-f04d-408a-a28f-d2ad3ff929f9 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:35.698753 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b411b-3c4b-41a4-8271-e39fceebd652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:35.699408 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b411b-3c4b-41a4-8271-e39fceebd652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:35.699729 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b411b-3c4b-41a4-8271-e39fceebd652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:35.700012 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b411b-3c4b-41a4-8271-e39fceebd652 admin admin] PATH_INFO: `/v3/projects/23d5b0bd661748cba3fe639731110c46/users/83e179f55f954278ad99631ad9d1cf4c/roles/06592016669243d99b430c46dd1c1d46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:35.701897 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b411b-3c4b-41a4-8271-e39fceebd652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d5b0bd661748cba3fe639731110c46, user_id=83e179f55f954278ad99631ad9d1cf4c, role_id=06592016669243d99b430c46dd1c1d46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:35.705264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b411b-3c4b-41a4-8271-e39fceebd652 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:35.717105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1470/2916] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 12:26:35 2022] PUT /identity/v3/projects/23d5b0bd661748cba3fe639731110c46/users/83e179f55f954278ad99631ad9d1cf4c/roles/06592016669243d99b430c46dd1c1d46 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:35.727762 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f088355-ba9c-456d-88e7-e0326e2155ca None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:35.728147 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f088355-ba9c-456d-88e7-e0326e2155ca None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:35.728466 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f088355-ba9c-456d-88e7-e0326e2155ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:35.757429 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-5f088355-ba9c-456d-88e7-e0326e2155ca None None] MFA Rules not processed for user `83e179f55f954278ad99631ad9d1cf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:35.758770 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5f088355-ba9c-456d-88e7-e0326e2155ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:35.832343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1447/2917] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:35.846473 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b411b-3c4b-41a4-8271-e39fceebd652 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:35.848854 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-bb0b411b-3c4b-41a4-8271-e39fceebd652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:35.909130 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b411b-3c4b-41a4-8271-e39fceebd652 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:35.913105 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0efa-e8dc-42b4-bf04-cb73a01128c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:35.913664 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0efa-e8dc-42b4-bf04-cb73a01128c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:35.913943 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0efa-e8dc-42b4-bf04-cb73a01128c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:35.914214 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0efa-e8dc-42b4-bf04-cb73a01128c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:35.971828 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c0efa-e8dc-42b4-bf04-cb73a01128c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:35.973247 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c0efa-e8dc-42b4-bf04-cb73a01128c2 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:35.982154 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1471/2918] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:38.130835 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f088355-ba9c-456d-88e7-e0326e2155ca None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:38.132222 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5f088355-ba9c-456d-88e7-e0326e2155ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:38.143864 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f088355-ba9c-456d-88e7-e0326e2155ca None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:38.147421 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439b922-fb09-47ad-9a5e-57aa195e79e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:38.148063 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439b922-fb09-47ad-9a5e-57aa195e79e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:38.148338 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439b922-fb09-47ad-9a5e-57aa195e79e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:38.148603 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439b922-fb09-47ad-9a5e-57aa195e79e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:38.204390 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439b922-fb09-47ad-9a5e-57aa195e79e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:38.206599 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439b922-fb09-47ad-9a5e-57aa195e79e5 service cinder] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:38.215553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1448/2919] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:39.685537 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0efa-e8dc-42b4-bf04-cb73a01128c2 service cinder] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:39.694776 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0efa-e8dc-42b4-bf04-cb73a01128c2 service cinder] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:39.698422 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33306bb1-d3df-4d48-aa85-b6e156c1b1b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce95a25d894457d8cd45c30b38f014e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:39.699028 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33306bb1-d3df-4d48-aa85-b6e156c1b1b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:39.699304 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33306bb1-d3df-4d48-aa85-b6e156c1b1b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:39.699577 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33306bb1-d3df-4d48-aa85-b6e156c1b1b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:39.712996 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33306bb1-d3df-4d48-aa85-b6e156c1b1b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:39.714476 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33306bb1-d3df-4d48-aa85-b6e156c1b1b4 service cinder] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:39.724855 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1472/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:44.405204 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439b922-fb09-47ad-9a5e-57aa195e79e5 service cinder] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:44.418005 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=100 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:44.469534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439b922-fb09-47ad-9a5e-57aa195e79e5 service cinder] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:44.474692 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:44.475321 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:44.475598 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:44.475904 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] PATH_INFO: `/v3/users/ea778ebb7b2f4a2a9fb5cb2d04533b6a` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:44.477009 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea778ebb7b2f4a2a9fb5cb2d04533b6a)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:44.478917 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:44.706056 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea778ebb7b2f4a2a9fb5cb2d04533b6a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:44.771388 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea778ebb7b2f4a2a9fb5cb2d04533b6a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:44.784127 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea778ebb7b2f4a2a9fb5cb2d04533b6a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:44.784793 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea778ebb7b2f4a2a9fb5cb2d04533b6a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:44.791849 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea778ebb7b2f4a2a9fb5cb2d04533b6a'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:44.799363 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1449/2921] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:44 2022] DELETE /identity/v3/users/ea778ebb7b2f4a2a9fb5cb2d04533b6a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:44.803929 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6fc82-c1bf-4ce1-97c8-ae85d8fbb4d8 None None] REQUEST_METHOD: `POST` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:44.804519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6fc82-c1bf-4ce1-97c8-ae85d8fbb4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:44.804519 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6fc82-c1bf-4ce1-97c8-ae85d8fbb4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:44.824067 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.auth.core [None req-8df6fc82-c1bf-4ce1-97c8-ae85d8fbb4d8 None None] MFA Rules not processed for user `e0d78cac7890401997b98a7dab7b659c`. Rule list: `[]` (Enabled: `True`). {{(pid=81774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:26:44.827344 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8df6fc82-c1bf-4ce1-97c8-ae85d8fbb4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:44.834464 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:44.884205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1473/2922] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 12:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:26:44.894133 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:44.896196 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:44.952715 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda14bf9-6f81-4a65-8fe5-737eee84779c admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:44.956562 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70f67-3411-4fcf-a8b1-2432be86e42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d492b570be4de4b6a6d85f6374ed31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:44.957094 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70f67-3411-4fcf-a8b1-2432be86e42d service neutron] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:44.957370 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70f67-3411-4fcf-a8b1-2432be86e42d service neutron] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:44.957637 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70f67-3411-4fcf-a8b1-2432be86e42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:44.966381 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e70f67-3411-4fcf-a8b1-2432be86e42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:44.967813 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e70f67-3411-4fcf-a8b1-2432be86e42d service neutron] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:44.976828 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1450/2923] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:26:45.404550 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6fc82-c1bf-4ce1-97c8-ae85d8fbb4d8 None None] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:45.405988 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-8df6fc82-c1bf-4ce1-97c8-ae85d8fbb4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:45.418222 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6fc82-c1bf-4ce1-97c8-ae85d8fbb4d8 None None] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:45.422983 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:45.427715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:45.427715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:45.427715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] PATH_INFO: `/v3/projects/d2b97fb1eb7d499f946a5c29559d3e08` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:45.427715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b97fb1eb7d499f946a5c29559d3e08)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:45.427715 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:45.532230 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b97fb1eb7d499f946a5c29559d3e08', 'request_id': 'req-d2dac201-baca-4880-9382-dd646130f431'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.593528 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b97fb1eb7d499f946a5c29559d3e08', 'request_id': 'req-d2dac201-baca-4880-9382-dd646130f431'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.600838 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b97fb1eb7d499f946a5c29559d3e08', 'request_id': 'req-d2dac201-baca-4880-9382-dd646130f431'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.611218 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] The token cache is being invalidate because project d2b97fb1eb7d499f946a5c29559d3e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:45.611508 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.612166 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.614264 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1474/2924] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:45 2022] DELETE /identity/v3/projects/d2b97fb1eb7d499f946a5c29559d3e08 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:45.618281 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70f67-3411-4fcf-a8b1-2432be86e42d service neutron] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:45.627969 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70f67-3411-4fcf-a8b1-2432be86e42d service neutron] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:45.658492 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:45.685553 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:45.692145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:45.692145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:45.692145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] PATH_INFO: `/v3/users/1e608b83a87245bd971ad4c67469bb95` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:45.692145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e608b83a87245bd971ad4c67469bb95)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:45.692145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:45.866563 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e608b83a87245bd971ad4c67469bb95'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.939596 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e608b83a87245bd971ad4c67469bb95'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.953189 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e608b83a87245bd971ad4c67469bb95'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.953856 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e608b83a87245bd971ad4c67469bb95'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.960973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e608b83a87245bd971ad4c67469bb95'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:45.966784 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1451/2925] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:45 2022] DELETE /identity/v3/users/1e608b83a87245bd971ad4c67469bb95 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:46.378575 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:46.381911 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:46.397363 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dac201-baca-4880-9382-dd646130f431 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:46.458674 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:46.459314 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:46.459887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:46.459887 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] PATH_INFO: `/v3/projects/5d221032d8444dd3bc693227bb2ebcf5` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:46.461084 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d221032d8444dd3bc693227bb2ebcf5)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:46.462989 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:46.550421 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:46.557160 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d221032d8444dd3bc693227bb2ebcf5', 'request_id': 'req-7b7ce17f-24c2-422e-8e11-e4e991d9d368'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:46.622703 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d221032d8444dd3bc693227bb2ebcf5', 'request_id': 'req-7b7ce17f-24c2-422e-8e11-e4e991d9d368'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:46.630649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d221032d8444dd3bc693227bb2ebcf5', 'request_id': 'req-7b7ce17f-24c2-422e-8e11-e4e991d9d368'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:46.642340 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] The token cache is being invalidate because project 5d221032d8444dd3bc693227bb2ebcf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:46.642628 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:46.643269 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:46.645341 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1475/2926] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:46 2022] DELETE /identity/v3/projects/5d221032d8444dd3bc693227bb2ebcf5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 12:26:46.649391 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:46.650933 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:46.664309 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddfe6e-b128-4769-bf8b-dae85d9cd4c3 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:46.721758 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:46.722396 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:46.722679 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:46.723534 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] PATH_INFO: `/v3/users/83e179f55f954278ad99631ad9d1cf4c` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:46.724889 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e179f55f954278ad99631ad9d1cf4c)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:46.726850 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:46.912273 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e179f55f954278ad99631ad9d1cf4c'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:46.979217 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e179f55f954278ad99631ad9d1cf4c'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:46.980612 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:46.993077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e179f55f954278ad99631ad9d1cf4c'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:46.994170 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e179f55f954278ad99631ad9d1cf4c'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:47.001145 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-bb365cd3-5962-462e-b352-d4e23e2678ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e179f55f954278ad99631ad9d1cf4c'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:47.007140 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1452/2927] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:26:46 2022] DELETE /identity/v3/users/83e179f55f954278ad99631ad9d1cf4c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:47.470597 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:26:47.472562 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:26:47.489176 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce17f-24c2-422e-8e11-e4e991d9d368 admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:26:47.563111 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:26:47.563810 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:26:47.564100 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:26:47.564380 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] PATH_INFO: `/v3/projects/23d5b0bd661748cba3fe639731110c46` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:26:47.565522 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d5b0bd661748cba3fe639731110c46)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:26:47.567495 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:26:47.729007 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d5b0bd661748cba3fe639731110c46', 'request_id': 'req-1064e035-7c41-44a6-8662-c618f28e47dd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:47.802869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d5b0bd661748cba3fe639731110c46', 'request_id': 'req-1064e035-7c41-44a6-8662-c618f28e47dd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:47.809708 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d5b0bd661748cba3fe639731110c46', 'request_id': 'req-1064e035-7c41-44a6-8662-c618f28e47dd'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:47.820234 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] The token cache is being invalidate because project 23d5b0bd661748cba3fe639731110c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:26:47.821973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:47.821973 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:26:47.822766 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1476/2928] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:26:47 2022] DELETE /identity/v3/projects/23d5b0bd661748cba3fe639731110c46 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:26:57.184930 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:57.817610 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:45.454490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133af8a-ab60-4255-ade8-61165cc1c72a None None] REQUEST_METHOD: `POST` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:27:45.454490 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133af8a-ab60-4255-ade8-61165cc1c72a None None] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:27:45.455105 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133af8a-ab60-4255-ade8-61165cc1c72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:27:45.475829 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.auth.core [None req-3133af8a-ab60-4255-ade8-61165cc1c72a None None] MFA Rules not processed for user `18bd4f37058e4019a1e5f13dfdcdc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:27:45.477035 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3133af8a-ab60-4255-ade8-61165cc1c72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:27:45.532425 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1453/2929] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 12:27:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:27:45.575804 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:27:45.577310 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:27:45.648649 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064e035-7c41-44a6-8662-c618f28e47dd admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:27:45.653757 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f011d-7602-4807-8aff-885830abe23d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063f7bf74f444c14b9bf6c0ca936dd12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:27:45.658008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f011d-7602-4807-8aff-885830abe23d service swift] REQUEST_METHOD: `GET` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:27:45.658008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f011d-7602-4807-8aff-885830abe23d service swift] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:27:45.658008 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f011d-7602-4807-8aff-885830abe23d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:27:45.663124 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f011d-7602-4807-8aff-885830abe23d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:27:45.664738 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f011d-7602-4807-8aff-885830abe23d service swift] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:27:45.672739 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1477/2930] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 12:27:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:27:54.019325 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133af8a-ab60-4255-ade8-61165cc1c72a None None] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:27:54.020876 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-3133af8a-ab60-4255-ade8-61165cc1c72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:27:54.086761 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133af8a-ab60-4255-ade8-61165cc1c72a None None] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:27:54.091318 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:27:54.091973 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:27:54.092289 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:27:54.092572 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] PATH_INFO: `/v3/users/25a397e3b5ba45e9af4efdd33ccc8963` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:27:54.093678 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a397e3b5ba45e9af4efdd33ccc8963)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:27:54.095600 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:27:54.284120 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a397e3b5ba45e9af4efdd33ccc8963'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.379703 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a397e3b5ba45e9af4efdd33ccc8963'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.392827 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a397e3b5ba45e9af4efdd33ccc8963'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.395734 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a397e3b5ba45e9af4efdd33ccc8963'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.401483 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a397e3b5ba45e9af4efdd33ccc8963'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.408047 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1454/2931] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:27:54 2022] DELETE /identity/v3/users/25a397e3b5ba45e9af4efdd33ccc8963 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:27:54.653993 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f011d-7602-4807-8aff-885830abe23d service swift] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:27:54.667455 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f011d-7602-4807-8aff-885830abe23d service swift] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:27:54.727071 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:27:54.727733 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:27:54.728020 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:27:54.728299 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] PATH_INFO: `/v3/projects/1717f903a6424ebe9d78cc62e4c64d71` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:27:54.729430 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1717f903a6424ebe9d78cc62e4c64d71)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:27:54.731324 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:27:54.837462 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1717f903a6424ebe9d78cc62e4c64d71', 'request_id': 'req-7a7c15aa-d6f1-4f47-a562-095e2703b90c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.899065 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1717f903a6424ebe9d78cc62e4c64d71', 'request_id': 'req-7a7c15aa-d6f1-4f47-a562-095e2703b90c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.905770 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1717f903a6424ebe9d78cc62e4c64d71', 'request_id': 'req-7a7c15aa-d6f1-4f47-a562-095e2703b90c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.916856 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] The token cache is being invalidate because project 1717f903a6424ebe9d78cc62e4c64d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:27:54.917152 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.917796 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:54.919277 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1478/2932] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:27:54 2022] DELETE /identity/v3/projects/1717f903a6424ebe9d78cc62e4c64d71 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:27:54.923359 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:27:54.924814 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:27:54.938817 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280026fe-ec2f-4499-887d-7a15df91b6a5 admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:27:54.959017 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:54.995732 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:27:54.996366 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:27:54.996646 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:27:54.996918 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] PATH_INFO: `/v3/users/589b525c6b534a45a9330c89774ab638` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:27:54.998077 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=589b525c6b534a45a9330c89774ab638)` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:27:55.000097 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:27:55.163209 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589b525c6b534a45a9330c89774ab638'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.223954 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589b525c6b534a45a9330c89774ab638'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.238848 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589b525c6b534a45a9330c89774ab638'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.239499 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589b525c6b534a45a9330c89774ab638'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.247259 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.notifications [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589b525c6b534a45a9330c89774ab638'} {{(pid=81773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.253176 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1455/2933] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 12:27:54 2022] DELETE /identity/v3/users/589b525c6b534a45a9330c89774ab638 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:27:55.524869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] Authenticating user token {{(pid=81774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:27:55.526424 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.fernet_utils [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:27:55.540735 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c15aa-d6f1-4f47-a562-095e2703b90c admin admin] Validating token access rules against request {{(pid=81774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:27:55.559334 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:55.599205 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0d78cac7890401997b98a7dab7b659c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a957b728ec1a4c5cb1b61c4acd7d2959', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:27:55.599869 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:27:55.600161 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:27:55.600439 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] PATH_INFO: `/v3/projects/18f373bc13a945718162ddf8ade929b5` {{(pid=81774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:27:55.601589 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f373bc13a945718162ddf8ade929b5)` {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:27:55.604191 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] RBAC: Authorization granted {{(pid=81774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:27:55.706004 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f373bc13a945718162ddf8ade929b5', 'request_id': 'req-8d68352d-8c37-4817-bae9-e81e4caaca0c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.797052 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f373bc13a945718162ddf8ade929b5', 'request_id': 'req-8d68352d-8c37-4817-bae9-e81e4caaca0c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.803975 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f373bc13a945718162ddf8ade929b5', 'request_id': 'req-8d68352d-8c37-4817-bae9-e81e4caaca0c'} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.814691 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] The token cache is being invalidate because project 18f373bc13a945718162ddf8ade929b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:27:55.819524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.819524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG keystone.notifications [None req-8d68352d-8c37-4817-bae9-e81e4caaca0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:27:55.819524 dv-cinder-852210-13-smb devstack@keystone.service[81774]: [pid: 81774|app: 0|req: 1479/2934] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 12:27:55 2022] DELETE /identity/v3/projects/18f373bc13a945718162ddf8ade929b5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:28:05.249659 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:28:05.811734 dv-cinder-852210-13-smb devstack@keystone.service[81774]: DEBUG dbcounter [-] [81774] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:30:58.601030 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] Authenticating user token {{(pid=81773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:30:58.602479 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:30:58.673950 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825633-bda0-4569-b98b-29915ab0e68f admin admin] Validating token access rules against request {{(pid=81773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:30:58.733248 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f5640-fdca-4de0-b90d-2144cb50bd5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a4b508dd7048df83f7beeacfe9c085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eebdfd43dee3423ba80b8c624e371e6f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:30:58.733877 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f5640-fdca-4de0-b90d-2144cb50bd5d service placement] REQUEST_METHOD: `GET` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:30:58.734168 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f5640-fdca-4de0-b90d-2144cb50bd5d service placement] SCRIPT_NAME: `/identity` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:30:58.734471 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f5640-fdca-4de0-b90d-2144cb50bd5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:30:58.736343 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.fernet_utils [None req-924f5640-fdca-4de0-b90d-2144cb50bd5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:30:58.747863 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f5640-fdca-4de0-b90d-2144cb50bd5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:30:58.749447 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f5640-fdca-4de0-b90d-2144cb50bd5d service placement] RBAC: Authorization granted {{(pid=81773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:30:58.760266 dv-cinder-852210-13-smb devstack@keystone.service[81773]: [pid: 81773|app: 0|req: 1456/2935] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 12:30:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:31:08.755141 dv-cinder-852210-13-smb devstack@keystone.service[81773]: DEBUG dbcounter [-] [81773] Writing DB stats keystone:SELECT=58 {{(pid=81773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}